Jul 09 14:58:52 devstack cinder-volume[75980]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 14:58:52 devstack cinder-volume[75980]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 14:58:52 devstack cinder-volume[75980]: we strongly recommend against using it for new projects. Jul 09 14:58:52 devstack cinder-volume[75980]: If you are already using Eventlet, we recommend migrating to a different Jul 09 14:58:52 devstack cinder-volume[75980]: framework. For more detail see Jul 09 14:58:52 devstack cinder-volume[75980]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 14:58:52 devstack cinder-volume[75980]: import eventlet # noqa Jul 09 14:58:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 14:58:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 14:58:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 14:58:55 devstack cinder-volume[75980]: INFO dbcounter [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Registered counter for database cinder Jul 09 14:58:55 devstack cinder-volume[75980]: DEBUG oslo_db.sqlalchemy.engines [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75980) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:58:55 devstack cinder-volume[75980]: DEBUG dbcounter [-] [75980] Writer thread running {{(pid=75980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 14:58:55 devstack cinder-volume[75980]: INFO cinder.rpc [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 14:58:55 devstack cinder-volume[75980]: INFO cinder.rpc [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_db.sqlalchemy.engines [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75980) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:58:56 devstack cinder-volume[75980]: INFO cinder.volume.manager [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Determined volume DB was empty at startup. Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG cinder.volume.manager [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75980) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 14:58:56 devstack cinder-volume[75980]: INFO cinder.volume.manager [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 14:58:56 devstack cinder-volume[75980]: WARNING stevedore.named [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 14:58:56 devstack cinder-volume[75980]: WARNING castellan.key_manager [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 14:58:56 devstack cinder-volume[75980]: WARNING cinder.keymgr.conf_key_mgr [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG cinder.volume.drivers.lvm [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75980) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] CMD "cinder-rtstool verify" returned: 0 in 0.385s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_db.sqlalchemy.engines [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75980) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:58:56 devstack cinder-volume[75980]: INFO cinder.rpc [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 14:58:56 devstack cinder-volume[75980]: INFO cinder.rpc [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 14:58:56 devstack cinder-volume[75980]: WARNING stevedore.named [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 14:58:56 devstack cinder-volume[75980]: WARNING castellan.key_manager [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 14:58:56 devstack cinder-volume[75980]: INFO cinder.volume.manager [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_db.sqlalchemy.engines [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75980) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:58:56 devstack cinder-volume[75980]: INFO oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Starting 1 workers Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Started child 76133 {{(pid=75980) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Full set of CONF: {{(pid=75980) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] ******************************************************************************** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Configuration options gathered from: {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] ================================================================================ {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] allow_availability_zone_fallback = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] allow_compression_on_image_upload = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] allowed_direct_url_schemes = [] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] api_rate_limit = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] auth_strategy = keystone {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[76133]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] az_cache_duration = 3600 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_availability_zone = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_host = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_name = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_stats_polling_interval = 60 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backup_api_class = cinder.backup.api.API {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backup_name_template = backup-%s {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backup_use_same_host = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backup_use_temp_snapshot = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] chap_password = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] chap_username = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cinder_internal_tenant_project_id = 6b85abe7dc844c7fba098615f0511d1d {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cinder_internal_tenant_user_id = 5544c861b36a457783e94578758ccc6c {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cloned_volume_same_az = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cluster = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] compression_format = gzip {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] compute_api_class = cinder.compute.nova.API {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] config_dir = [] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] config_source = [] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] control_exchange = openstack {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] debug = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] default_availability_zone = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] default_group_type = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] default_volume_type = lvmdriver-1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] disk_geometry = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] driver_client_cert = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] driver_client_cert_key = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] driver_data_namespace = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] driver_ssl_cert_path = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] driver_ssl_cert_verify = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] driver_use_ssl = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] enable_force_upload = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] enable_new_services = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] enable_unsupported_driver = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] enforce_multipath_for_image_xfer = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] filter_function = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance_api_insecure = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance_api_servers = ['http://192.168.122.198/image'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance_api_ssl_compression = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance_ca_certificates_file = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance_catalog_info = image:glance:publicURL {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance_certfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance_keyfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance_num_retries = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance_request_timeout = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] goodness_function = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[76133]: INFO cinder.volume.manager [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 14:58:56 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] graceful_shutdown_timeout = 5 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] group_api_class = cinder.group.api.API {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] host = devstack {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] image_compress_on_upload = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] image_conversion_address_space_limit = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] image_conversion_cpu_limit = 60 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] image_conversion_disable = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] image_upload_use_cinder_backend = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] image_upload_use_internal_tenant = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] image_volume_cache_enabled = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] image_volume_cache_max_count = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] image_volume_cache_max_size_gb = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] init_host_max_objects_retrieval = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] instance_format = [instance: %(uuid)s] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] iscsi_target_flags = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] iscsi_write_cache = on {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] iser_helper = tgtadm {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] iser_ip_address = 192.168.122.198 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] iser_port = 3260 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] log_color = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] log_config_append = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] log_dir = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] log_file = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] log_options = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] log_rotate_interval = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] log_rotate_interval_type = days {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] log_rotation_type = none {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] max_age = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] max_logfile_count = 30 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] max_logfile_size_mb = 200 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] max_over_subscription_ratio = 20.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] message_reap_interval = 86400 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] message_ttl = 2592000 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] migration_create_volume_timeout_secs = 300 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] monkey_patch = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] monkey_patch_modules = [] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] my_ip = 192.168.122.198 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] no_snapshot_gb_quota = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] num_iser_scan_tries = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] num_shell_tries = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] num_volume_device_scan_tries = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] nvmeof_conn_info_version = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] nvmet_ns_id = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] nvmet_port_id = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] osapi_max_limit = 1000 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] osapi_volume_ext_list = [] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] osapi_volume_listen_port = 8776 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] osapi_volume_use_ssl = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] osapi_volume_workers = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] per_volume_size_limit = -1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] periodic_fuzzy_delay = 60 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] periodic_interval = 60 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] public_endpoint = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] publish_errors = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] quota_backup_gigabytes = 1000 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] quota_backups = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] quota_gigabytes = 1000 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] quota_groups = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] quota_snapshots = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] quota_volumes = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] rate_limit_burst = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] rate_limit_except_level = CRITICAL {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] rate_limit_interval = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] reinit_driver_count = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] replication_device = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] report_discard_supported = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] report_interval = 120 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] reservation_clean_interval = 86400 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] reservation_expire = 86400 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] reserved_image_namespaces = [] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] reserved_percentage = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] rpc_response_timeout = 120 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] run_external_periodic_tasks = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] scst_target_driver = iscsi {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] scst_target_iqn_name = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_down_time = 720 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] shell_completion = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] snapshot_name_template = snapshot-%s {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] snapshot_same_host = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] split_loggers = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] state_path = /opt/stack/data/cinder {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] storage_availability_zone = nova {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] storage_protocol = iSCSI {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] syslog_log_facility = LOG_USER {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] target_helper = lioadm {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] target_ip_address = 192.168.122.198 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] target_port = 3260 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] target_protocol = iscsi {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] target_secondary_ip_addresses = [] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] trace_flags = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] transport_url = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] until_refresh = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] use_chap_auth = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] use_default_quota_class = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] use_journal = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] use_json = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] use_multipath_for_image_xfer = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] use_stderr = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] use_syslog = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] verify_glance_signatures = enabled {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_api_class = cinder.volume.api.API {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_backend_name = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_clear = zero {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_clear_ionice = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_clear_size = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_copy_bps_limit = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_dd_blocksize = 1M {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_name_template = volume-%s {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_service_inithost_offload = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volume_usage_audit_period = month {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] zoning_mode = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_concurrency.disable_process_locking = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.auth_section = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.auth_type = password {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.auth_version = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.cache = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.certfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.include_service_catalog = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.insecure = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.interface = public {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.keyfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_password = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcache_username = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.region_name = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.service_type = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.198/identity {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.backend = dogpile.cache.null {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.backend_argument = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.backend_expiration_time = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.config_prefix = cache.oslo {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.debug_cache_backend = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.enable_retry_client = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.enable_socket_keepalive = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.enabled = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.expiration_time = 600 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.hashclient_retry_attempts = 2 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.memcache_dead_retry = 300 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.memcache_pool_maxsize = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.memcache_sasl_enabled = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.password = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.proxies = [] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.redis_db = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.redis_server = localhost:6379 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.retry_attempts = 2 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.retry_delay = 0.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.socket_keepalive_count = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.socket_keepalive_idle = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.socket_keepalive_interval = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.socket_timeout = 1.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.tls_allowed_ciphers = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.tls_cafile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.tls_certfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.tls_enabled = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.tls_keyfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cache.username = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] coordination.backend_url = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.asyncio_connection = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.asyncio_slave_connection = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.backend = sqlalchemy {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.connection = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.connection_debug = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.connection_parameters = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.connection_recycle_time = 3600 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.connection_trace = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.db_inc_retry_interval = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.db_max_retries = 20 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.db_max_retry_interval = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.db_retry_interval = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.max_overflow = 50 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.max_pool_size = 5 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.max_retries = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.mysql_wsrep_sync_wait = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.pool_timeout = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.retry_interval = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.slave_connection = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.sqlite_synchronous = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.synchronous_reader = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] database.use_db_reconnect = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.connection_string = messaging:// {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.enabled = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.es_doc_type = notification {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.es_scroll_size = 10000 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.es_scroll_time = 2m {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.filter_error_trace = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.hmac_keys = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.sentinel_service_name = mymaster {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.socket_timeout = 0.1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.trace_requests = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler.trace_sqlalchemy = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler_jaeger.process_tags = {} {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler_jaeger.service_name_prefix = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] profiler_otlp.service_name_prefix = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.enforce_new_defaults = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.enforce_scope = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.policy_default_rule = default {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.policy_file = policy.yaml {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] privsep_osbrick.group = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] privsep_osbrick.helper_command = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] privsep_osbrick.user = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cinder_sys_admin.group = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cinder_sys_admin.helper_command = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack sudo[76137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] cinder_sys_admin.user = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_user.auth_section = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_user.auth_type = password {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_user.cafile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_user.certfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_user.collect_timing = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_user.insecure = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack sudo[76137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_user.keyfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_user.send_service_user_token = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_user.split_loggers = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] service_user.timeout = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance.auth_section = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance.auth_type = password {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance.certfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance.collect_timing = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance.insecure = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance.keyfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance.region_name = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance.split_loggers = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] glance.timeout = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.backend_availability_zone = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.chap_password = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.chap_username = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.disk_geometry = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.driver_client_cert = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.driver_client_cert_key = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.driver_data_namespace = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.driver_use_ssl = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.extra_capabilities = {} {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.filter_function = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.goodness_function = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.iscsi_target_flags = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.iscsi_write_cache = on {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.iser_helper = tgtadm {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.iser_ip_address = 192.168.122.198 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.iser_port = 3260 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.lvm_share_target = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.lvm_type = auto {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.num_shell_tries = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.replication_device = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.report_discard_supported = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:56 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.reserved_percentage = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.target_helper = tgtadm {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.target_ip_address = 192.168.122.198 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.target_port = 3260 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.target_protocol = iscsi {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.trace_flags = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.unique_fqdn_network = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.use_chap_auth = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.volume_backend_name = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.volume_clear = zero {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.volume_clear_ionice = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.volume_clear_size = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_reports.file_event_handler = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_reports.log_dir = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.backend_host = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.chap_password = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.chap_username = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.disk_geometry = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.driver_client_cert = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.extra_capabilities = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.filter_function = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.goodness_function = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.iser_helper = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.iser_ip_address = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.iser_port = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.lvm_share_target = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.lvm_type = auto {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.num_shell_tries = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.replication_device = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.report_discard_supported = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.reserved_percentage = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.scst_target_driver = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.storage_protocol = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.target_helper = lioadm {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.target_ip_address = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.target_port = 3260 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.trace_flags = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.use_chap_auth = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.volume_clear = zero {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.volume_clear_size = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] lvmdriver-1.volumes_dir = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.ssl = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_notifications.driver = [] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_notifications.retry = -1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] key_manager.fixed_key = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.barbican_api_version = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.barbican_endpoint = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.barbican_endpoint_type = public {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.barbican_region_name = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.cafile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.certfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.collect_timing = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.insecure = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.keyfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.number_of_retries = 60 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.retry_delay = 1 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.send_service_user_token = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.split_loggers = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.timeout = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.verify_ssl = True {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican.verify_ssl_path = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican_service_user.auth_section = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican_service_user.auth_type = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican_service_user.cafile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican_service_user.certfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican_service_user.collect_timing = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican_service_user.insecure = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican_service_user.keyfile = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican_service_user.split_loggers = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] barbican_service_user.timeout = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.approle_role_id = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.approle_secret_id = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.kv_mountpoint = secret {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.kv_path = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.kv_version = 2 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.namespace = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.root_token_id = **** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.ssl_ca_crt_file = None {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.timeout = 60.0 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.use_ssl = False {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:58:57 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] ******************************************************************************** {{(pid=75980) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 14:58:57 devstack sudo[76137]: pam_unix(sudo:session): session closed for user root Jul 09 14:58:57 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:58:57 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:58:57 devstack sudo[76142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:58:57 devstack sudo[76142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:58:58 devstack sudo[76142]: pam_unix(sudo:session): session closed for user root Jul 09 14:58:58 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.657s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:58:58 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:58:58 devstack cinder-volume[76133]: INFO cinder.brick.local_dev.lvm [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 14:58:58 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:58:58 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:58:58 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:58:58 devstack sudo[76332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:58:58 devstack sudo[76332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:58:59 devstack sudo[76332]: pam_unix(sudo:session): session closed for user root Jul 09 14:58:59 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:58:59 devstack cinder-volume[76133]: DEBUG cinder.brick.local_dev.lvm [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76133) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 09 14:58:59 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:58:59 devstack sudo[76537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:58:59 devstack sudo[76537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:00 devstack sudo[76537]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:00 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.731s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:00 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:00 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:00 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:00 devstack sudo[76860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:59:00 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:01 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:01 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.796s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:01 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:01 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:01 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:01 devstack sudo[76917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 14:59:01 devstack sudo[76917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:02 devstack sudo[76917]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:02 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.783s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:02 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:02 devstack sudo[76927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:59:02 devstack sudo[76927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:03 devstack sudo[76927]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:03 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.925s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:03 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:03 devstack sudo[76932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:59:03 devstack sudo[76932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:04 devstack sudo[76932]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:04 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:04 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:04 devstack sudo[76941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:59:04 devstack sudo[76941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:04 devstack sudo[76941]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:04 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:04 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:04 devstack sudo[76946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:59:04 devstack sudo[76946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:05 devstack sudo[76946]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:05 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:05 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:05 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:05 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:05 devstack sudo[76950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:59:05 devstack sudo[76950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:06 devstack sudo[76950]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:06 devstack cinder-volume[76133]: INFO cinder.volume.drivers.lvm [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 14:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:06 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:59:06 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:06 devstack cinder-volume[75980]: DEBUG dbcounter [-] [75980] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:59:06 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.750s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:06 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 14:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:06 devstack sudo[77077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:59:06 devstack sudo[77077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:07 devstack sudo[77077]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:07 devstack sudo[77080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:59:07 devstack sudo[77080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:08 devstack sudo[77080]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:08 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:08 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:08 devstack sudo[77220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:59:08 devstack sudo[77220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:08 devstack sudo[77220]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:08 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:08 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:08 devstack sudo[77224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:59:08 devstack sudo[77224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:09 devstack sudo[77224]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:09 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:09 devstack cinder-volume[76133]: INFO cinder.volume.driver [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 14:59:09 devstack cinder-volume[76133]: DEBUG cinder.volume.driver [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76133) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 14:59:09 devstack cinder-volume[76133]: DEBUG oslo_db.sqlalchemy.engines [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76133) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:59:09 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writer thread running {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 14:59:09 devstack cinder-volume[76133]: DEBUG cinder.db.api [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Building query based on filter {{(pid=76133) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 14:59:09 devstack cinder-volume[76133]: DEBUG cinder.image.image_utils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76133) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 14:59:09 devstack cinder-volume[76133]: INFO cinder.keymgr.migration [None req-720fe8da-c22e-432c-b787-1c1f61f12fcb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 14:59:09 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 14:59:09 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:09 devstack sudo[77232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:59:09 devstack sudo[77232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:10 devstack sudo[77232]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:10 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:10 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:10 devstack sudo[77235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:59:10 devstack sudo[77235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:10 devstack sudo[77235]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:10 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:10 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:11 devstack sudo[77238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:59:11 devstack sudo[77238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:11 devstack sudo[77238]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:11 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:11 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:11 devstack sudo[77242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:59:11 devstack sudo[77242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:12 devstack sudo[77242]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:12 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:12 devstack cinder-volume[76133]: DEBUG cinder.manager [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Notifying Schedulers of capabilities ... {{(pid=76133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:59:12 devstack cinder-volume[76133]: INFO cinder.volume.manager [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Driver initialization completed successfully. Jul 09 14:59:12 devstack cinder-volume[76133]: INFO cinder.manager [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Initiating service 2 cleanup Jul 09 14:59:12 devstack cinder-volume[76133]: INFO cinder.manager [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Service 2 cleanup completed. Jul 09 14:59:12 devstack cinder-volume[76133]: DEBUG cinder.service [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Creating RPC server for service cinder-volume {{(pid=76133) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 14:59:12 devstack cinder-volume[76133]: DEBUG cinder.service [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76133) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 14:59:12 devstack cinder-volume[76133]: INFO cinder.volume.manager [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 14:59:12 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 14:59:12 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:12 devstack sudo[77246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:59:12 devstack sudo[77246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:13 devstack sudo[77246]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:13 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:13 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:13 devstack sudo[77259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:59:13 devstack sudo[77259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:13 devstack sudo[77259]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:13 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:13 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:13 devstack sudo[77262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:59:13 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:14 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:14 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.670s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:14 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:59:14 devstack sudo[77319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:59:14 devstack sudo[77319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:59:15 devstack sudo[77319]: pam_unix(sudo:session): session closed for user root Jul 09 14:59:15 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:59:15 devstack cinder-volume[76133]: INFO cinder.volume.manager [None req-cc1d7bcf-9b30-4145-a2ce-8ca4d3718908 None None] Driver post RPC initialization completed successfully. Jul 09 14:59:25 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:59:25 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:59:26 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running periodic task VolumeManager._thread_info {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:59:26 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] thread count: 6 {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:59:26 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] thread info: [<_MainThread(MainThread, started 129401421406336)>, , , , , ] {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:00:26 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:00:26 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 15:00:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:00:26 devstack sudo[79514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:00:26 devstack sudo[79514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:00:26 devstack sudo[79514]: pam_unix(sudo:session): session closed for user root Jul 09 15:00:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:00:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:00:26 devstack sudo[79604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:00:26 devstack sudo[79604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:00:27 devstack sudo[79604]: pam_unix(sudo:session): session closed for user root Jul 09 15:00:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:00:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:00:27 devstack sudo[79607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:00:27 devstack sudo[79607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:00:28 devstack sudo[79607]: pam_unix(sudo:session): session closed for user root Jul 09 15:00:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:00:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:00:28 devstack sudo[79610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:00:28 devstack sudo[79610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:00:28 devstack sudo[79610]: pam_unix(sudo:session): session closed for user root Jul 09 15:00:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:00:28 devstack cinder-volume[76133]: DEBUG cinder.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Notifying Schedulers of capabilities ... {{(pid=76133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:00:28 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running periodic task VolumeManager._thread_info {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:00:28 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] thread count: 6 {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:00:28 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] thread info: [<_MainThread(MainThread, started 129401421406336)>, , , , , ] {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:01:25 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:01:26 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:01:26 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 15:01:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:26 devstack sudo[82600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:01:26 devstack sudo[82600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:26 devstack sudo[82600]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:26 devstack sudo[82611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:01:26 devstack sudo[82611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:27 devstack sudo[82611]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:27 devstack sudo[82621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:01:27 devstack sudo[82621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:28 devstack sudo[82621]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:28 devstack sudo[82625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:01:28 devstack sudo[82625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:28 devstack sudo[82625]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:28 devstack cinder-volume[76133]: DEBUG cinder.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Notifying Schedulers of capabilities ... {{(pid=76133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:01:28 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running periodic task VolumeManager._thread_info {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:01:28 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] thread count: 6 {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:01:28 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] thread info: [<_MainThread(MainThread, started 129401421406336)>, , , , , ] {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:02:26 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:02:26 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 15:02:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:26 devstack sudo[84841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:02:26 devstack sudo[84841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:26 devstack sudo[84841]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:26 devstack sudo[84854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:02:26 devstack sudo[84854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:27 devstack sudo[84854]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:27 devstack sudo[84859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:02:27 devstack sudo[84859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:28 devstack sudo[84859]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:28 devstack sudo[84873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:02:28 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:28 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:28 devstack cinder-volume[76133]: DEBUG cinder.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Notifying Schedulers of capabilities ... {{(pid=76133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:03:25 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:SELECT=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:03:25 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:UPDATE=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:03:26 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:03:26 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 15:03:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:26 devstack sudo[86121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:03:26 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:26 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:26 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:26 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:03:26 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:27 devstack cinder-volume[75980]: INFO oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Caught SIGTERM, stopping children Jul 09 15:03:27 devstack cinder-volume[75980]: DEBUG oslo_concurrency.lockutils [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Acquiring lock "singleton_lock" {{(pid=75980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:03:27 devstack cinder-volume[75980]: DEBUG oslo_concurrency.lockutils [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Acquired lock "singleton_lock" {{(pid=75980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:03:27 devstack cinder-volume[75980]: DEBUG oslo_concurrency.lockutils [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Releasing lock "singleton_lock" {{(pid=75980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:03:27 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Stop services. {{(pid=75980) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 15:03:27 devstack cinder-volume[75980]: DEBUG oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Killing children. {{(pid=75980) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 15:03:27 devstack cinder-volume[75980]: INFO oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Waiting on 1 children to exit Jul 09 15:03:27 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:27 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:03:27 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:28 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:28 devstack sudo[86219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:03:28 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:28 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:28 devstack cinder-volume[76133]: DEBUG cinder.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Notifying Schedulers of capabilities ... {{(pid=76133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:03:28 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] Running periodic task VolumeManager._thread_info {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:03:28 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] thread count: 5 {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:03:28 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-93600bfd-3263-4c51-bcc5-e7b3405be2f1 None None] thread info: [<_MainThread(MainThread, started 129401421406336)>, , , , ] {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:03:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.lockutils [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Acquiring lock "singleton_lock" {{(pid=76133) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:03:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.lockutils [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Acquired lock "singleton_lock" {{(pid=76133) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:03:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.lockutils [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Releasing lock "singleton_lock" {{(pid=76133) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:03:28 devstack cinder-volume[76133]: WARNING amqp [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 15:03:28 devstack cinder-volume[76133]: WARNING amqp [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 15:03:28 devstack cinder-volume[75980]: INFO oslo_service.backend._eventlet.service [None req-326c8ab9-cdbf-4d4f-b362-e639f7636a89 None None] Child 76133 exited with status 0 Jul 09 15:03:29 devstack cinder-volume[86223]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 15:03:29 devstack cinder-volume[86223]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 15:03:29 devstack cinder-volume[86223]: we strongly recommend against using it for new projects. Jul 09 15:03:29 devstack cinder-volume[86223]: If you are already using Eventlet, we recommend migrating to a different Jul 09 15:03:29 devstack cinder-volume[86223]: framework. For more detail see Jul 09 15:03:29 devstack cinder-volume[86223]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 15:03:29 devstack cinder-volume[86223]: import eventlet # noqa Jul 09 15:03:31 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:03:31 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:03:31 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:03:31 devstack cinder-volume[86223]: INFO dbcounter [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Registered counter for database cinder Jul 09 15:03:31 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG dbcounter [-] [86223] Writer thread running {{(pid=86223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 15:03:32 devstack cinder-volume[86223]: INFO cinder.rpc [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 15:03:32 devstack cinder-volume[86223]: INFO cinder.rpc [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:03:32 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Determined volume DB was empty at startup. Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG cinder.volume.manager [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86223) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 15:03:32 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 15:03:32 devstack cinder-volume[86223]: WARNING stevedore.named [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 15:03:32 devstack cinder-volume[86223]: WARNING castellan.key_manager [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:03:32 devstack cinder-volume[86223]: WARNING cinder.keymgr.conf_key_mgr [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:03:32 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:03:32 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Starting 1 workers Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Started child 86470 {{(pid=86223) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Full set of CONF: {{(pid=86223) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] ******************************************************************************** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Configuration options gathered from: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] ================================================================================ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] allow_availability_zone_fallback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] allow_compression_on_image_upload = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] allowed_direct_url_schemes = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] api_rate_limit = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] auth_strategy = keystone {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86470]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_stats_polling_interval = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backup_api_class = cinder.backup.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backup_name_template = backup-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backup_use_same_host = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backup_use_temp_snapshot = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] chap_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cinder_internal_tenant_project_id = 6b85abe7dc844c7fba098615f0511d1d {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cinder_internal_tenant_user_id = 5544c861b36a457783e94578758ccc6c {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cluster = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] compression_format = gzip {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] compute_api_class = cinder.compute.nova.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] config_dir = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] config_source = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] control_exchange = openstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] debug = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] default_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] default_group_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] default_volume_type = QuobyteHD {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] driver_ssl_cert_verify = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] driver_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] enable_new_services = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] enable_unsupported_driver = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] enabled_backends = ['QuobyteHD'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] enforce_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance_api_insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance_api_servers = ['http://192.168.122.198/image'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance_api_ssl_compression = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance_ca_certificates_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance_catalog_info = image:glance:publicURL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance_num_retries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance_request_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] graceful_shutdown_timeout = 5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] group_api_class = cinder.group.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] host = devstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] image_compress_on_upload = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] image_conversion_address_space_limit = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] image_conversion_cpu_limit = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] image_conversion_disable = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] image_upload_use_cinder_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] image_upload_use_internal_tenant = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] image_volume_cache_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] image_volume_cache_max_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] image_volume_cache_max_size_gb = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] init_host_max_objects_retrieval = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] instance_format = [instance: %(uuid)s] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] iscsi_target_flags = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] iscsi_write_cache = on {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] iser_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] iser_ip_address = 192.168.122.198 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] iser_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] log_color = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] log_config_append = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] log_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] log_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] log_options = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] log_rotate_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] log_rotate_interval_type = days {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] log_rotation_type = none {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] max_age = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] max_logfile_count = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] max_logfile_size_mb = 200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86470]: INFO cinder.volume.manager [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 15:03:32 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.remotefs [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86470) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] max_over_subscription_ratio = 20.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] message_reap_interval = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] message_ttl = 2592000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] migration_create_volume_timeout_secs = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] monkey_patch = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] monkey_patch_modules = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] my_ip = 192.168.122.198 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] no_snapshot_gb_quota = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] num_iser_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] num_shell_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] num_volume_device_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] nvmeof_conn_info_version = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] nvmet_ns_id = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] nvmet_port_id = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] osapi_max_limit = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] osapi_volume_ext_list = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] osapi_volume_listen_port = 8776 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] osapi_volume_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] osapi_volume_workers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] per_volume_size_limit = -1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] periodic_fuzzy_delay = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] periodic_interval = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] public_endpoint = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] publish_errors = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] quota_backup_gigabytes = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] quota_backups = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] quota_gigabytes = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] quota_groups = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] quota_snapshots = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] quota_volumes = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] rate_limit_burst = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] rate_limit_except_level = CRITICAL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] rate_limit_interval = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] reinit_driver_count = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] report_discard_supported = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] report_interval = 120 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] reservation_clean_interval = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] reservation_expire = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] reserved_image_namespaces = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] reserved_percentage = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] rpc_response_timeout = 120 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] run_external_periodic_tasks = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] scst_target_driver = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_down_time = 720 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] shell_completion = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] snapshot_name_template = snapshot-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] state_path = /opt/stack/data/cinder {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] storage_availability_zone = nova {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] storage_protocol = iSCSI {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] syslog_log_facility = LOG_USER {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] target_helper = lioadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] target_ip_address = 192.168.122.198 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] target_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] target_protocol = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] target_secondary_ip_addresses = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] transport_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] until_refresh = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] use_chap_auth = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] use_default_quota_class = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] use_journal = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] use_json = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] use_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] use_stderr = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] use_syslog = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] verify_glance_signatures = enabled {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_api_class = cinder.volume.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_clear = zero {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_clear_size = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_copy_bps_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_dd_blocksize = 1M {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_name_template = volume-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_service_inithost_offload = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volume_usage_audit_period = month {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] zoning_mode = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_concurrency.disable_process_locking = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.auth_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.include_service_catalog = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.interface = public {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_password = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcache_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.service_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.198/identity {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.backend = dogpile.cache.null {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86470) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 15:03:32 devstack cinder-volume[86470]: WARNING cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 15:03:32 devstack cinder-volume[86470]: WARNING cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.backend_argument = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Running cmd (subprocess): mount.quobyte {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.backend_expiration_time = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.config_prefix = cache.oslo {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.debug_cache_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.enable_retry_client = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.enable_socket_keepalive = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.expiration_time = 600 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.hashclient_retry_attempts = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.memcache_dead_retry = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.memcache_pool_maxsize = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.memcache_sasl_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.proxies = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.redis_db = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.redis_server = localhost:6379 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.retry_attempts = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.retry_delay = 0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.socket_keepalive_count = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.socket_keepalive_idle = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.socket_keepalive_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.socket_timeout = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.tls_allowed_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.tls_cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.tls_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.tls_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.tls_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cache.username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] coordination.backend_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.asyncio_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.asyncio_slave_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.backend = sqlalchemy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.connection_debug = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.connection_parameters = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.connection_recycle_time = 3600 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.connection_trace = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.db_inc_retry_interval = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.db_max_retries = 20 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.db_max_retry_interval = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.db_retry_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.max_overflow = 50 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.max_pool_size = 5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.max_retries = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.mysql_wsrep_sync_wait = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.pool_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.retry_interval = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.slave_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.sqlite_synchronous = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.synchronous_reader = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] database.use_db_reconnect = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.connection_string = messaging:// {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.es_doc_type = notification {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.es_scroll_size = 10000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.es_scroll_time = 2m {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.filter_error_trace = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.hmac_keys = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.sentinel_service_name = mymaster {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.socket_timeout = 0.1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.trace_requests = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler.trace_sqlalchemy = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler_jaeger.process_tags = {} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler_jaeger.service_name_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] profiler_otlp.service_name_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.enforce_new_defaults = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.enforce_scope = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.policy_default_rule = default {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.policy_file = policy.yaml {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] privsep_osbrick.group = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] privsep_osbrick.helper_command = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] privsep_osbrick.user = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cinder_sys_admin.group = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cinder_sys_admin.helper_command = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] cinder_sys_admin.user = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_user.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_user.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_user.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_user.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_user.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_user.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_user.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_user.send_service_user_token = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_user.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] service_user.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance.region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] glance.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.chap_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.driver_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.extra_capabilities = {} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.iscsi_target_flags = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.iscsi_write_cache = on {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.iser_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.iser_ip_address = 192.168.122.198 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.iser_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nas_host = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nas_login = admin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nas_mount_options = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nas_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nas_private_key = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nas_share_path = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.num_shell_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.quobyte_volume_url = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.report_discard_supported = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.reserved_percentage = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.target_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.target_ip_address = 192.168.122.198 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.target_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.target_protocol = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.unique_fqdn_network = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.use_chap_auth = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.volume_backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.volume_clear = zero {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.volume_clear_size = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_reports.file_event_handler = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_reports.log_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack quobyte-client[86475]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 15:03:32 devstack quobyte-client[86475]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.backend_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.chap_username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.chiscsi_conf = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:03:32 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:03:32 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=86470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86470]: INFO cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 ... Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.driver_use_ssl = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc -c /etc/quobyte/client-cinder.cfg {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.extra_capabilities = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.iser_helper = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.iser_ip_address = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.iser_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.iser_target_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nas_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nas_login = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nas_mount_options = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nas_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nas_private_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nas_share_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nas_ssh_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:32 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.num_shell_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.nvmet_port_id = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.report_discard_supported = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.reserved_percentage = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.scst_target_driver = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.storage_protocol = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.target_helper = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.target_ip_address = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.target_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.target_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.target_protocol = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.use_chap_auth = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.volume_clear = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.volume_clear_size = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] QuobyteHD.volumes_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack sudo[86476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc -c /etc/quobyte/client-cinder.cfg Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_notifications.driver = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_notifications.retry = -1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] key_manager.fixed_key = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.barbican_api_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.barbican_endpoint = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.barbican_endpoint_type = public {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.barbican_region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.number_of_retries = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.retry_delay = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.send_service_user_token = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.verify_ssl = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican.verify_ssl_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican_service_user.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican_service_user.auth_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican_service_user.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican_service_user.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican_service_user.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican_service_user.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican_service_user.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican_service_user.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] barbican_service_user.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.approle_role_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.approle_secret_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.kv_mountpoint = secret {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.kv_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.kv_version = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.root_token_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.ssl_ca_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:33 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] ******************************************************************************** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 15:03:34 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:34 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.077s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:34 devstack cinder-volume[86470]: INFO cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 succeeded Jul 09 15:03:34 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=86470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:03:34 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.114s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:03:34 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:34 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:03:34 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:34 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:34 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.886s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:34 devstack cinder-volume[86470]: INFO cinder.volume.driver [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 15:03:34 devstack cinder-volume[86470]: DEBUG cinder.volume.driver [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86470) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG oslo_db.sqlalchemy.engines [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG dbcounter [-] [86470] Writer thread running {{(pid=86470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG cinder.db.api [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Building query based on filter {{(pid=86470) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG cinder.image.image_utils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86470) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 15:03:35 devstack cinder-volume[86470]: INFO cinder.keymgr.migration [None req-e426ceff-03ad-4215-a03b-196d1702500e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=86470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=86470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:35 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:03:35 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:35 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.622s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG cinder.manager [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Notifying Schedulers of capabilities ... {{(pid=86470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:03:35 devstack cinder-volume[86470]: INFO cinder.volume.manager [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Driver initialization completed successfully. Jul 09 15:03:35 devstack cinder-volume[86470]: INFO cinder.manager [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Initiating service 3 cleanup Jul 09 15:03:35 devstack cinder-volume[86470]: INFO cinder.manager [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Service 3 cleanup completed. Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG cinder.service [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Creating RPC server for service cinder-volume {{(pid=86470) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG cinder.service [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86470) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 15:03:35 devstack cinder-volume[86470]: INFO cinder.volume.manager [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=86470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=86470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:03:35 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:35 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:03:35 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:36 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:36 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.703s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:36 devstack cinder-volume[86470]: INFO cinder.volume.manager [None req-647b027a-d318-4883-b2c4-ba91e5e1cd22 None None] Driver post RPC initialization completed successfully. Jul 09 15:03:37 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-7270e771-bb62-4262-a672-b534db250f91 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:03:37 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-7270e771-bb62-4262-a672-b534db250f91 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:03:37 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-7270e771-bb62-4262-a672-b534db250f91 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=86470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:03:37 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-7270e771-bb62-4262-a672-b534db250f91 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=86470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:03:37 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-7270e771-bb62-4262-a672-b534db250f91 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:03:37 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-7270e771-bb62-4262-a672-b534db250f91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:37 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:03:37 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:38 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:38 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-7270e771-bb62-4262-a672-b534db250f91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.597s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:38 devstack cinder-volume[86470]: DEBUG cinder.manager [None req-7270e771-bb62-4262-a672-b534db250f91 None None] Notifying Schedulers of capabilities ... {{(pid=86470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:03:40 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Caught SIGTERM, stopping children Jul 09 15:03:40 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Acquiring lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:03:40 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Acquired lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:03:40 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Releasing lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:03:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Stop services. {{(pid=86223) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 15:03:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Killing children. {{(pid=86223) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 15:03:40 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Waiting on 1 children to exit Jul 09 15:03:44 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Acquiring lock "singleton_lock" {{(pid=86470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:03:44 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Acquired lock "singleton_lock" {{(pid=86470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:03:44 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Releasing lock "singleton_lock" {{(pid=86470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:03:44 devstack cinder-volume[86470]: WARNING amqp [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 15:03:44 devstack cinder-volume[86470]: WARNING amqp [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 15:03:44 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-a5b81024-7cd3-4d70-8831-ae5d39a2999b None None] Child 86470 exited with status 0 Jul 09 15:03:44 devstack cinder-volume[86762]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 15:03:44 devstack cinder-volume[86762]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 15:03:44 devstack cinder-volume[86762]: we strongly recommend against using it for new projects. Jul 09 15:03:44 devstack cinder-volume[86762]: If you are already using Eventlet, we recommend migrating to a different Jul 09 15:03:44 devstack cinder-volume[86762]: framework. For more detail see Jul 09 15:03:44 devstack cinder-volume[86762]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 15:03:44 devstack cinder-volume[86762]: import eventlet # noqa Jul 09 15:03:47 devstack cinder-volume[86762]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86762) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:03:47 devstack cinder-volume[86762]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86762) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:03:47 devstack cinder-volume[86762]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86762) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:03:47 devstack cinder-volume[86762]: INFO dbcounter [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Registered counter for database cinder Jul 09 15:03:47 devstack cinder-volume[86762]: DEBUG oslo_db.sqlalchemy.engines [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86762) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG dbcounter [-] [86762] Writer thread running {{(pid=86762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 15:03:48 devstack cinder-volume[86762]: INFO cinder.rpc [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 15:03:48 devstack cinder-volume[86762]: INFO cinder.rpc [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_db.sqlalchemy.engines [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86762) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:03:48 devstack cinder-volume[86762]: INFO cinder.volume.manager [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Determined volume DB was empty at startup. Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG cinder.volume.manager [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86762) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 15:03:48 devstack cinder-volume[86762]: WARNING stevedore.named [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 15:03:48 devstack cinder-volume[86762]: WARNING castellan.key_manager [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:03:48 devstack cinder-volume[86762]: WARNING cinder.keymgr.conf_key_mgr [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:03:48 devstack cinder-volume[86762]: INFO cinder.volume.manager [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_db.sqlalchemy.engines [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86762) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:03:48 devstack cinder-volume[86762]: INFO oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Starting 1 workers Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Started child 87042 {{(pid=86762) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Full set of CONF: {{(pid=86762) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] ******************************************************************************** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] Configuration options gathered from: {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] ================================================================================ {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] allow_availability_zone_fallback = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] allow_compression_on_image_upload = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] allowed_direct_url_schemes = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] api_rate_limit = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] auth_strategy = keystone {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_availability_zone = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_host = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_stats_polling_interval = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backup_api_class = cinder.backup.api.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backup_name_template = backup-%s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backup_use_same_host = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backup_use_temp_snapshot = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] chap_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] chap_username = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cinder_internal_tenant_project_id = 6b85abe7dc844c7fba098615f0511d1d {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[87042]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cinder_internal_tenant_user_id = 5544c861b36a457783e94578758ccc6c {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cluster = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] compression_format = gzip {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] compute_api_class = cinder.compute.nova.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] config_dir = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] config_source = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] control_exchange = openstack {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] debug = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] default_availability_zone = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] default_group_type = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] default_volume_type = QuobyteHD {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] disk_geometry = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] driver_client_cert = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] driver_client_cert_key = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] driver_data_namespace = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] driver_ssl_cert_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] driver_ssl_cert_verify = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] driver_use_ssl = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] enable_new_services = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] enable_unsupported_driver = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] enabled_backends = ['QuobyteHD'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] enforce_multipath_for_image_xfer = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] filter_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance_api_insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance_api_servers = ['http://192.168.122.198/image'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance_api_ssl_compression = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance_ca_certificates_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance_catalog_info = image:glance:publicURL {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance_certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance_keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance_num_retries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance_request_timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] goodness_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] graceful_shutdown_timeout = 5 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] group_api_class = cinder.group.api.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] host = devstack {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] image_compress_on_upload = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] image_conversion_address_space_limit = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] image_conversion_cpu_limit = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] image_conversion_disable = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] image_upload_use_cinder_backend = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] image_upload_use_internal_tenant = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] image_volume_cache_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] image_volume_cache_max_count = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] image_volume_cache_max_size_gb = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] init_host_max_objects_retrieval = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] instance_format = [instance: %(uuid)s] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] iscsi_target_flags = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] iscsi_write_cache = on {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] iser_helper = tgtadm {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] iser_ip_address = 192.168.122.198 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] iser_port = 3260 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] log_color = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] log_config_append = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] log_dir = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] log_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] log_options = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] log_rotate_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] log_rotate_interval_type = days {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] log_rotation_type = none {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] max_age = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] max_logfile_count = 30 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] max_logfile_size_mb = 200 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] max_over_subscription_ratio = 20.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] message_reap_interval = 86400 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] message_ttl = 2592000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] migration_create_volume_timeout_secs = 300 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] monkey_patch = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] monkey_patch_modules = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] my_ip = 192.168.122.198 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] no_snapshot_gb_quota = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] num_iser_scan_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] num_shell_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] num_volume_device_scan_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] nvmeof_conn_info_version = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] nvmet_ns_id = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] nvmet_port_id = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] osapi_max_limit = 1000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] osapi_volume_ext_list = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] osapi_volume_listen_port = 8776 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] osapi_volume_use_ssl = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] osapi_volume_workers = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] per_volume_size_limit = -1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] periodic_fuzzy_delay = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] periodic_interval = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] public_endpoint = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] publish_errors = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] quota_backup_gigabytes = 1000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] quota_backups = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] quota_gigabytes = 1000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] quota_groups = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] quota_snapshots = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] quota_volumes = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] rate_limit_burst = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] rate_limit_except_level = CRITICAL {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] rate_limit_interval = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] reinit_driver_count = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] replication_device = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] report_discard_supported = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] report_interval = 120 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] reservation_clean_interval = 86400 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] reservation_expire = 86400 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] reserved_image_namespaces = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] reserved_percentage = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87042) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] rpc_response_timeout = 120 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] run_external_periodic_tasks = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] scst_target_driver = iscsi {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] scst_target_iqn_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_down_time = 720 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] shell_completion = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] snapshot_name_template = snapshot-%s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] split_loggers = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] state_path = /opt/stack/data/cinder {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] storage_availability_zone = nova {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] storage_protocol = iSCSI {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] syslog_log_facility = LOG_USER {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] target_helper = lioadm {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] target_ip_address = 192.168.122.198 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] target_port = 3260 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] target_protocol = iscsi {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] target_secondary_ip_addresses = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] trace_flags = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] transport_url = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] until_refresh = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] use_chap_auth = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] use_default_quota_class = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] use_journal = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] use_json = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] use_multipath_for_image_xfer = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] use_stderr = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] use_syslog = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] verify_glance_signatures = enabled {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_api_class = cinder.volume.api.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_backend_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_clear = zero {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_clear_ionice = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_clear_size = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_copy_bps_limit = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_dd_blocksize = 1M {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_name_template = volume-%s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_service_inithost_offload = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volume_usage_audit_period = month {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] zoning_mode = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_concurrency.disable_process_locking = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.auth_section = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.auth_type = password {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.auth_version = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.cache = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.include_service_catalog = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.interface = public {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_password = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcache_username = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.region_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.service_type = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.198/identity {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.backend = dogpile.cache.null {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.backend_argument = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.backend_expiration_time = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.config_prefix = cache.oslo {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.debug_cache_backend = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.enable_retry_client = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.enable_socket_keepalive = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.expiration_time = 600 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.hashclient_retry_attempts = 2 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.memcache_dead_retry = 300 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.memcache_pool_maxsize = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.memcache_sasl_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.proxies = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.redis_db = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.redis_server = localhost:6379 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.retry_attempts = 2 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.retry_delay = 0.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.socket_keepalive_count = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.socket_keepalive_idle = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.socket_keepalive_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.socket_timeout = 1.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.tls_allowed_ciphers = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.tls_cafile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.tls_certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.tls_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.tls_keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cache.username = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] coordination.backend_url = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.asyncio_connection = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.asyncio_slave_connection = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.backend = sqlalchemy {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.connection = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.connection_debug = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.connection_parameters = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.connection_recycle_time = 3600 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.connection_trace = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.db_inc_retry_interval = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.db_max_retries = 20 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.db_max_retry_interval = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.db_retry_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.max_overflow = 50 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.max_pool_size = 5 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.max_retries = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.mysql_wsrep_sync_wait = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.pool_timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.retry_interval = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.slave_connection = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.sqlite_synchronous = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.synchronous_reader = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] database.use_db_reconnect = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.connection_string = messaging:// {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.es_doc_type = notification {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.es_scroll_size = 10000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.es_scroll_time = 2m {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.filter_error_trace = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.hmac_keys = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.sentinel_service_name = mymaster {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.socket_timeout = 0.1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.trace_requests = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler.trace_sqlalchemy = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler_jaeger.process_tags = {} {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler_jaeger.service_name_prefix = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] profiler_otlp.service_name_prefix = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.enforce_new_defaults = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.enforce_scope = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.policy_default_rule = default {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.policy_file = policy.yaml {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] privsep_osbrick.group = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] privsep_osbrick.helper_command = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] privsep_osbrick.user = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cinder_sys_admin.group = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cinder_sys_admin.helper_command = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] cinder_sys_admin.user = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_user.auth_section = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_user.auth_type = password {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_user.cafile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_user.certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_user.collect_timing = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_user.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_user.keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_user.send_service_user_token = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_user.split_loggers = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] service_user.timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance.auth_section = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance.auth_type = password {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance.certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance.collect_timing = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance.keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance.region_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance.split_loggers = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] glance.timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.backend_availability_zone = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87042) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 15:03:48 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.quobyte [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 15:03:48 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.quobyte [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Running cmd (subprocess): mount.quobyte {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.chap_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.chap_username = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.disk_geometry = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.driver_client_cert = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.driver_client_cert_key = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.driver_data_namespace = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.driver_use_ssl = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.extra_capabilities = {} {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.filter_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.goodness_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.iscsi_target_flags = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.iscsi_write_cache = on {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.iser_helper = tgtadm {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.iser_ip_address = 192.168.122.198 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.iser_port = 3260 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nas_host = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nas_login = admin {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nas_mount_options = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nas_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nas_private_key = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nas_share_path = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.num_shell_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.quobyte_volume_url = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.replication_device = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.report_discard_supported = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.reserved_percentage = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.target_helper = tgtadm {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.target_ip_address = 192.168.122.198 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.target_port = 3260 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.target_protocol = iscsi {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.trace_flags = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.unique_fqdn_network = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.use_chap_auth = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.volume_backend_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.volume_clear = zero {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.volume_clear_ionice = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.volume_clear_size = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_reports.file_event_handler = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_reports.log_dir = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.backend_availability_zone = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.backend_host = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.chap_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.chap_username = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.chiscsi_conf = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.disk_geometry = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.driver_client_cert = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.driver_data_namespace = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.driver_use_ssl = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.extra_capabilities = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.filter_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.goodness_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.iser_helper = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.iser_ip_address = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.iser_port = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.iser_target_prefix = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nas_host = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nas_login = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nas_mount_options = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nas_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nas_private_key = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nas_share_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nas_ssh_port = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.num_shell_tries = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.nvmet_port_id = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.replication_device = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.report_discard_supported = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.reserved_percentage = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.scst_target_driver = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.storage_protocol = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.target_helper = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.target_ip_address = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.target_port = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.target_prefix = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.target_protocol = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.trace_flags = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.use_chap_auth = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.volume_clear = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.volume_clear_size = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] QuobyteHD.volumes_dir = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.ssl = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_notifications.driver = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_notifications.retry = -1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] key_manager.fixed_key = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.barbican_api_version = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.barbican_endpoint = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.barbican_endpoint_type = public {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.barbican_region_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.cafile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.collect_timing = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.number_of_retries = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.retry_delay = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.send_service_user_token = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.split_loggers = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.verify_ssl = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican.verify_ssl_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican_service_user.auth_section = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican_service_user.auth_type = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican_service_user.cafile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican_service_user.certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican_service_user.collect_timing = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican_service_user.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican_service_user.keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican_service_user.split_loggers = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] barbican_service_user.timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.approle_role_id = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.approle_secret_id = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.kv_mountpoint = secret {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.kv_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.kv_version = 2 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.namespace = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.root_token_id = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.ssl_ca_crt_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.timeout = 60.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.use_ssl = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:03:48 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-3314a050-537a-46cb-ad28-ca0dca173e1c None None] ******************************************************************************** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 15:03:48 devstack quobyte-client[87051]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 15:03:48 devstack quobyte-client[87051]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 15:03:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:03:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:03:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:03:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:03:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:03:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:48 devstack sudo[87055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:03:48 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:49 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.615s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:49 devstack cinder-volume[87042]: INFO cinder.volume.driver [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Driver hasn't implemented _init_vendor_properties() Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG cinder.volume.driver [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87042) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG oslo_db.sqlalchemy.engines [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87042) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writer thread running {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG cinder.db.api [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Building query based on filter {{(pid=87042) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87042) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:03:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:49 devstack cinder-volume[87042]: INFO cinder.keymgr.migration [None req-7e42d800-b5ba-4955-89d4-05ea63e63a18 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 15:03:49 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:03:49 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:50 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.600s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:03:50 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Driver initialization completed successfully. Jul 09 15:03:50 devstack cinder-volume[87042]: INFO cinder.manager [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Initiating service 3 cleanup Jul 09 15:03:50 devstack cinder-volume[87042]: INFO cinder.manager [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Service 3 cleanup completed. Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG cinder.service [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Creating RPC server for service cinder-volume {{(pid=87042) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG cinder.service [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87042) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 15:03:50 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:50 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:03:50 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:50 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.661s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:50 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-386e1a14-da01-425e-95e1-955a10cf710e None None] Driver post RPC initialization completed successfully. Jul 09 15:03:58 devstack cinder-volume[86762]: DEBUG dbcounter [-] [86762] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:04:00 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:04:00 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=2 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:04:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:04:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 6 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:04:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Flow 'volume_create_manager' (0f91ca11-351d-43c8-83f6-4b57c27e3061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ed1236-fdb1-406e-bf9e-0a901962cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ed1236-fdb1-406e-bf9e-0a901962cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-541825831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee67e5e3-a427-43fb-9688-a9b13100e45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f5cdf0c6414260b6b0c3f2db3d8e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:04:54Z,use_quota=True,user_id='598d5775f4934c4383a69550b726b0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79d0045-3e38-4cde-b3ff-7351deda51b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79d0045-3e38-4cde-b3ff-7351deda51b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c022a26b-2a74-4952-b1c9-66d0b4d628c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c022a26b-2a74-4952-b1c9-66d0b4d628c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee67e5e3-a427-43fb-9688-a9b13100e45f', 'volume_name': 'volume-ee67e5e3-a427-43fb-9688-a9b13100e45f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a6a15e-af0d-4344-a9e8-ef33cb98b7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a6a15e-af0d-4344-a9e8-ef33cb98b7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88433d0d-2fd7-45e7-bc2f-4db327712aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:04:54 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Volume ee67e5e3-a427-43fb-9688-a9b13100e45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee67e5e3-a427-43fb-9688-a9b13100e45f', 'volume_size': 1} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-541825831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee67e5e3-a427-43fb-9688-a9b13100e45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f5cdf0c6414260b6b0c3f2db3d8e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:04:54Z,use_quota=True,user_id='598d5775f4934c4383a69550b726b0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Creating volume ee67e5e3-a427-43fb-9688-a9b13100e45f {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:04:54 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:04:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:04:54 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f 1073741824 Jul 09 15:04:54 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:04:57 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Jul 09 15:04:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f 1073741824" returned: 0 in 2.546s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:04:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:04:57 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f Jul 09 15:04:57 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:04:59 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Jul 09 15:04:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f" returned: 0 in 2.214s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:04:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] <== create_volume: return (4952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:04:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.956s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:04:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88433d0d-2fd7-45e7-bc2f-4db327712aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee67e5e3-a427-43fb-9688-a9b13100e45f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:04:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97703d91-7ca2-4f64-9456-6439705cfed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:04:59 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Volume volume-ee67e5e3-a427-43fb-9688-a9b13100e45f (ee67e5e3-a427-43fb-9688-a9b13100e45f): created successfully Jul 09 15:04:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97703d91-7ca2-4f64-9456-6439705cfed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:04:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Flow 'volume_create_manager' (0f91ca11-351d-43c8-83f6-4b57c27e3061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:04:59 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-4ba8ea6b-1015-4833-973a-c68c81fa9f36 tempest-DeleteServersTestJSON-1951291582 None] Created volume successfully. Jul 09 15:05:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:05:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:05:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:05:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:05:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:05:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:05:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:04 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:05:04 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:06 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.943s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:06 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:05:06 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:05:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 6 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:05:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:05:08 devstack cinder-volume[87042]: WARNING py.warnings [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 09 15:05:08 devstack cinder-volume[87042]: .first() Jul 09 15:05:08 devstack cinder-volume[87042]: Jul 09 15:05:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:05:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:05:08 devstack cinder-volume[87042]: INFO oslo.privsep.daemon [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm6efn1ev/privsep.sock'] Jul 09 15:05:08 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm6efn1ev/privsep.sock Jul 09 15:05:08 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:08 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 15:05:08 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 15:05:08 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 15:05:08 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 15:05:08 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 15:05:08 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 15:05:08 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 15:05:09 devstack cinder-volume[87042]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 15:05:09 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:05:10 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:10 devstack cinder-volume[87042]: INFO oslo.privsep.daemon [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] Spawned new privsep daemon via rootwrap Jul 09 15:05:10 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] Accepted privsep connection to /tmp/tmpm6efn1ev/privsep.sock {{(pid=87042) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 15:05:10 devstack cinder-volume[87042]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 15:05:10 devstack cinder-volume[87042]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 15:05:10 devstack cinder-volume[87042]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 15:05:10 devstack cinder-volume[87042]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88299 Jul 09 15:05:10 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[181e7237-791f-4c03-809d-8ec3658242fc]: (2,) {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:05:10 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31d238a-0cd2-42c6-938a-479063851819]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:05:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:10 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f Jul 09 15:05:10 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:11 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f" returned: 0 in 0.980s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.050s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:05:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-ee67e5e3-a427-43fb-9688-a9b13100e45f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '325dd5ff-705a-4797-bb37-2f536b07629b', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:05:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-2f3a0db0-f27d-4a9d-9ee3-11bea1ed9829 req-58bf6493-a808-4b42-80e5-e65ae7781a77 tempest-DeleteServersTestJSON-1951291582 None] attachment_update completed successfully. Jul 09 15:05:20 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-2cd2b8da-d1d8-4e6f-bcfd-e64f5f1b001f req-c8ed467d-e004-438c-9796-e04658edb837 tempest-DeleteServersTestJSON-1951291582 None] Terminate volume connection completed successfully. Jul 09 15:05:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-2cd2b8da-d1d8-4e6f-bcfd-e64f5f1b001f req-c8ed467d-e004-438c-9796-e04658edb837 tempest-DeleteServersTestJSON-1951291582 None] Deleting attachment 325dd5ff-705a-4797-bb37-2f536b07629b. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Flow 'volume_create_manager' (a07fa436-dc1d-4f44-80d1-5608e148ee50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d26c602-5295-4612-a61c-2d23a9fee2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d26c602-5295-4612-a61c-2d23a9fee2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-791324315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f39af56-e414-4254-a31f-06fe69cba0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472f53bbe3894a0ab8b1dd1314387b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:05:21Z,use_quota=True,user_id='feb109a82f1b4d73b9d605eecca6ce4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b29d49-59f7-4237-9317-7c66c887c2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b29d49-59f7-4237-9317-7c66c887c2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff692b2-5fce-49e6-85bf-0a82c7ecd1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff692b2-5fce-49e6-85bf-0a82c7ecd1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f39af56-e414-4254-a31f-06fe69cba0bf', 'volume_name': 'volume-3f39af56-e414-4254-a31f-06fe69cba0bf', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f0b19d-3c59-4744-829e-b1d02ffb3ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f0b19d-3c59-4744-829e-b1d02ffb3ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3435195d-fb4d-4818-80d2-6152c3692f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Volume 3f39af56-e414-4254-a31f-06fe69cba0bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f39af56-e414-4254-a31f-06fe69cba0bf', 'volume_size': 1} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-791324315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f39af56-e414-4254-a31f-06fe69cba0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472f53bbe3894a0ab8b1dd1314387b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:05:21Z,use_quota=True,user_id='feb109a82f1b4d73b9d605eecca6ce4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Creating volume 3f39af56-e414-4254-a31f-06fe69cba0bf {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:05:21 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:21 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf 1073741824 Jul 09 15:05:21 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Flow 'volume_create_manager' (fe1ff8b6-7d3e-480e-979d-c8d3713cb062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9536d476-2539-484f-983a-8295c2fb4582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9536d476-2539-484f-983a-8295c2fb4582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-50540830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5457c649-4131-4670-a07c-7ae8a57e3a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9f44d5d91448128c5f64e839fbc2a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:05:22Z,use_quota=True,user_id='31ed7d493704458aa43fa9b80d9f715a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775ab8ef-1ac6-47e1-b837-7b3b6659f247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775ab8ef-1ac6-47e1-b837-7b3b6659f247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f8850a-60bb-4fb4-b6c5-007b962dfcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f8850a-60bb-4fb4-b6c5-007b962dfcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5457c649-4131-4670-a07c-7ae8a57e3a99', 'volume_name': 'volume-5457c649-4131-4670-a07c-7ae8a57e3a99', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900b31d2-cc40-4054-a3b0-b6c91f24fd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900b31d2-cc40-4054-a3b0-b6c91f24fd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1112263-1ed1-477e-8602-777b0a01ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Volume 5457c649-4131-4670-a07c-7ae8a57e3a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5457c649-4131-4670-a07c-7ae8a57e3a99', 'volume_size': 1} Jul 09 15:05:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:05:22 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf 1073741824" returned: 0 in 1.101s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:22 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf Jul 09 15:05:22 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:23 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf" returned: 0 in 0.961s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.337s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-50540830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5457c649-4131-4670-a07c-7ae8a57e3a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9f44d5d91448128c5f64e839fbc2a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:05:22Z,use_quota=True,user_id='31ed7d493704458aa43fa9b80d9f715a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Creating volume 5457c649-4131-4670-a07c-7ae8a57e3a99 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:05:23 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:23 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 1073741824 Jul 09 15:05:23 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3435195d-fb4d-4818-80d2-6152c3692f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f39af56-e414-4254-a31f-06fe69cba0bf', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303dfad6-9529-484b-be09-9ea102f35517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Volume volume-3f39af56-e414-4254-a31f-06fe69cba0bf (3f39af56-e414-4254-a31f-06fe69cba0bf): created successfully Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303dfad6-9529-484b-be09-9ea102f35517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Flow 'volume_create_manager' (a07fa436-dc1d-4f44-80d1-5608e148ee50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:05:23 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6d4a82a4-3544-4385-8a8e-c760d33a5abd tempest-AttachVolumeShelveTestJSON-1239639239 None] Created volume successfully. Jul 09 15:05:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Acquiring lock "cinder-ee67e5e3-a427-43fb-9688-a9b13100e45f-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:05:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Lock "cinder-ee67e5e3-a427-43fb-9688-a9b13100e45f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:05:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Acquiring lock "cinder-quobyte-ee67e5e3-a427-43fb-9688-a9b13100e45f" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:05:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Lock "cinder-quobyte-ee67e5e3-a427-43fb-9688-a9b13100e45f" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:05:24 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eed647-77fb-4875-9af2-7e0f10a7813d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:05:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:24 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 1073741824" returned: 0 in 1.277s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:24 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f Jul 09 15:05:24 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:24 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 Jul 09 15:05:24 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:25 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99" returned: 0 in 0.944s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:05:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:05:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1112263-1ed1-477e-8602-777b0a01ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5457c649-4131-4670-a07c-7ae8a57e3a99', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0fb55c-389b-4afe-8924-59d6a20f6bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:05:25 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Volume volume-5457c649-4131-4670-a07c-7ae8a57e3a99 (5457c649-4131-4670-a07c-7ae8a57e3a99): created successfully Jul 09 15:05:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0fb55c-389b-4afe-8924-59d6a20f6bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:05:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Flow 'volume_create_manager' (fe1ff8b6-7d3e-480e-979d-c8d3713cb062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:05:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3f466bc2-9ebf-4740-8077-02eae3199d41 tempest-ServerActionsTestOtherA-1604072392 None] Created volume successfully. Jul 09 15:05:25 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f" returned: 0 in 1.252s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:25 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f Jul 09 15:05:25 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:26 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ee67e5e3-a427-43fb-9688-a9b13100e45f" returned: 0 in 0.888s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Lock "cinder-quobyte-ee67e5e3-a427-43fb-9688-a9b13100e45f" released by "delete_volume" :: held 2.215s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:05:26 devstack cinder-volume[87042]: WARNING cinder.quota [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:05:26 devstack cinder-volume[87042]: WARNING cinder.quota [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:05:26 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Created reservations ['e1270cbd-f832-49b7-aa6a-809a3c76b1b5', '5e26b132-1cca-47e8-9397-68821a6b02df', '3b6ab876-651c-464b-ad0a-42341ad90753', '83b0581f-4631-437c-ba56-9b5daea52680'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:05:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:05:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:05:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:05:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:05:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:05:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:26 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:05:26 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:27 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.882s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:27 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:05:27 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Deleted volume successfully. Jul 09 15:05:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5d69837f-493c-43f4-847b-b99b488e787c tempest-DeleteServersTestJSON-1951291582 None] Lock "cinder-ee67e5e3-a427-43fb-9688-a9b13100e45f-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:05:36 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=20,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:05:37 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=14,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:05:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-12f2ccb9-644d-4e0c-b6cd-c80316fd6039 req-8997aadc-6483-4d16-bb56-983a07f70825 tempest-AttachVolumeShelveTestJSON-1239639239 None] No connector for attachment 21ee7a39-d5a4-4661-8a82-594095c114c1; skipping storage backend terminate_connection call. {{(pid=87042) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 15:05:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-12f2ccb9-644d-4e0c-b6cd-c80316fd6039 req-8997aadc-6483-4d16-bb56-983a07f70825 tempest-AttachVolumeShelveTestJSON-1239639239 None] Deleting attachment 21ee7a39-d5a4-4661-8a82-594095c114c1. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:06:00 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=1 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:06:01 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:06:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:06:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:04 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:06:04 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:05 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.938s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:06:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:06:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 8 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:06:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Flow 'volume_create_manager' (e4e4e18f-c6f8-4f1b-a35f-354c73b73832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267fce96-a538-484b-8b66-5796238c760e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267fce96-a538-484b-8b66-5796238c760e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1839735554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23717ae7-2e6b-4d67-a1de-3a8b1cb079aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da324ec3b17465bb8ec983b2f04b010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:06:10Z,use_quota=True,user_id='0f9b0be1b8ce4a428b46e1af52f179e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a41fc34-cec9-4575-ae42-44bbaabb259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a41fc34-cec9-4575-ae42-44bbaabb259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15471293-f3da-49e0-bcb0-f269d6628fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15471293-f3da-49e0-bcb0-f269d6628fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23717ae7-2e6b-4d67-a1de-3a8b1cb079aa', 'volume_name': 'volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e82f03-df39-4c17-af71-09dfb334c67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e82f03-df39-4c17-af71-09dfb334c67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e03d33-5891-420c-a825-6f5a59350242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:10 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Volume 23717ae7-2e6b-4d67-a1de-3a8b1cb079aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa', 'volume_size': 1} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1839735554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23717ae7-2e6b-4d67-a1de-3a8b1cb079aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da324ec3b17465bb8ec983b2f04b010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:06:10Z,use_quota=True,user_id='0f9b0be1b8ce4a428b46e1af52f179e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Creating volume 23717ae7-2e6b-4d67-a1de-3a8b1cb079aa {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:06:10 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:06:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:10 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa 1073741824 Jul 09 15:06:10 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:12 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa 1073741824" returned: 0 in 1.842s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:12 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa Jul 09 15:06:12 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:13 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa" returned: 0 in 1.100s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] <== create_volume: return (3010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:06:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e03d33-5891-420c-a825-6f5a59350242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfd3865-2f59-43d6-9051-25f086fa8843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:13 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Volume volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa (23717ae7-2e6b-4d67-a1de-3a8b1cb079aa): created successfully Jul 09 15:06:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfd3865-2f59-43d6-9051-25f086fa8843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Flow 'volume_create_manager' (e4e4e18f-c6f8-4f1b-a35f-354c73b73832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:06:13 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1571d41a-a1b5-451c-b76a-e394edd77319 tempest-TaggedAttachmentsTest-1225108225 None] Created volume successfully. Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Flow 'volume_create_manager' (7b51c60a-7211-4642-b00c-970d81c33e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3bc3ba-bdad-4d37-96a5-1f7264045cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3bc3ba-bdad-4d37-96a5-1f7264045cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-695906567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4acb389-97f8-4ed5-9c1c-a3f7a7779056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88367965395747b78dad87887f180956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:06:23Z,use_quota=True,user_id='6b643f2511944c0799afa57fea47ae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ab3d3e-d705-4478-891a-f675b902bb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ab3d3e-d705-4478-891a-f675b902bb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2afac60-080a-44d3-a1f0-7c02204a0285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2afac60-080a-44d3-a1f0-7c02204a0285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4acb389-97f8-4ed5-9c1c-a3f7a7779056', 'volume_name': 'volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e5df28-8a1f-4a8a-be8d-4c6ada2cfff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e5df28-8a1f-4a8a-be8d-4c6ada2cfff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e410a440-dcb7-4f0b-85fb-11b13a25d917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Volume e4acb389-97f8-4ed5-9c1c-a3f7a7779056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056', 'volume_size': 1} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-695906567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4acb389-97f8-4ed5-9c1c-a3f7a7779056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88367965395747b78dad87887f180956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:06:23Z,use_quota=True,user_id='6b643f2511944c0799afa57fea47ae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Creating volume e4acb389-97f8-4ed5-9c1c-a3f7a7779056 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:06:22 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:06:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:22 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056 1073741824 Jul 09 15:06:22 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:25 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056 1073741824" returned: 0 in 2.163s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:25 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056 Jul 09 15:06:25 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-09fed2d6-acb8-4a12-bb25-be2ffd999ae3 req-b17c8430-b403-451c-9e23-664240e6cd13 tempest-ServerActionsTestOtherA-1604072392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:25 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056" returned: 0 in 0.876s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] <== create_volume: return (3111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:06:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.123s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-09fed2d6-acb8-4a12-bb25-be2ffd999ae3 req-b17c8430-b403-451c-9e23-664240e6cd13 tempest-ServerActionsTestOtherA-1604072392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.238s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3a9b86-8cc4-4e9e-8a89-e963238bfba2]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:06:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-09fed2d6-acb8-4a12-bb25-be2ffd999ae3 req-b17c8430-b403-451c-9e23-664240e6cd13 tempest-ServerActionsTestOtherA-1604072392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e410a440-dcb7-4f0b-85fb-11b13a25d917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cec821-5d8b-4972-b19b-1d3e4e50f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:06:26 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Volume volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056 (e4acb389-97f8-4ed5-9c1c-a3f7a7779056): created successfully Jul 09 15:06:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cec821-5d8b-4972-b19b-1d3e4e50f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:06:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Flow 'volume_create_manager' (7b51c60a-7211-4642-b00c-970d81c33e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:06:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-14c59809-5935-481f-a046-4ac0ea0738ff tempest-VolumesAdminNegativeTest-1941704328 None] Created volume successfully. Jul 09 15:06:26 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 Jul 09 15:06:26 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:27 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-09fed2d6-acb8-4a12-bb25-be2ffd999ae3 req-b17c8430-b403-451c-9e23-664240e6cd13 tempest-ServerActionsTestOtherA-1604072392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99" returned: 0 in 1.186s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-09fed2d6-acb8-4a12-bb25-be2ffd999ae3 req-b17c8430-b403-451c-9e23-664240e6cd13 tempest-ServerActionsTestOtherA-1604072392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.224s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-09fed2d6-acb8-4a12-bb25-be2ffd999ae3 req-b17c8430-b403-451c-9e23-664240e6cd13 tempest-ServerActionsTestOtherA-1604072392 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-5457c649-4131-4670-a07c-7ae8a57e3a99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '973c69cb-aaf7-424d-b65b-18c424e3860b', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:06:27 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-09fed2d6-acb8-4a12-bb25-be2ffd999ae3 req-b17c8430-b403-451c-9e23-664240e6cd13 tempest-ServerActionsTestOtherA-1604072392 None] attachment_update completed successfully. Jul 09 15:06:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Acquiring lock "cinder-e4acb389-97f8-4ed5-9c1c-a3f7a7779056-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:06:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Lock "cinder-e4acb389-97f8-4ed5-9c1c-a3f7a7779056-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:06:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Acquiring lock "cinder-quobyte-e4acb389-97f8-4ed5-9c1c-a3f7a7779056" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:06:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Lock "cinder-quobyte-e4acb389-97f8-4ed5-9c1c-a3f7a7779056" acquired by "delete_volume" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:06:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ae66df-6ff4-4884-8992-ae1982774a5b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:06:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:28 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056 Jul 09 15:06:28 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:29 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056" returned: 0 in 1.169s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:29 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056 Jul 09 15:06:29 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:30 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e4acb389-97f8-4ed5-9c1c-a3f7a7779056" returned: 0 in 0.899s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Lock "cinder-quobyte-e4acb389-97f8-4ed5-9c1c-a3f7a7779056" released by "delete_volume" :: held 2.139s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:06:30 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Created reservations ['28a665a6-edf9-4314-9d5a-b4d23234fcdd', '27b29471-7cb5-42a2-a652-9a8f54a953e5', 'c390d3b0-301e-4551-a0c8-e3c162648340', 'a51fa63b-b47a-41bd-97c1-6ba28da5fdaa'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:06:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:30 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:06:30 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:32 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.583s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:32 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:06:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Deleted volume successfully. Jul 09 15:06:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8846e890-b5fc-4e62-bfa5-b88625d590cc tempest-VolumesAdminNegativeTest-1941704328 None] Lock "cinder-e4acb389-97f8-4ed5-9c1c-a3f7a7779056-delete_volume" released by "delete_volume" :: held 4.366s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:06:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-48fc0d5c-1915-4ed5-940a-940a415634dd req-677c7e5f-cd4f-48c3-b153-3caca9d2c4ab tempest-ServerActionsTestOtherA-1604072392 None] Terminate volume connection completed successfully. Jul 09 15:06:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-48fc0d5c-1915-4ed5-940a-940a415634dd req-677c7e5f-cd4f-48c3-b153-3caca9d2c4ab tempest-ServerActionsTestOtherA-1604072392 None] Deleting attachment 973c69cb-aaf7-424d-b65b-18c424e3860b. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:06:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-48fc0d5c-1915-4ed5-940a-940a415634dd req-ef115c5b-179f-4c21-9b94-cbb0e9ae2810 tempest-ServerActionsTestOtherA-1604072392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-48fc0d5c-1915-4ed5-940a-940a415634dd req-ef115c5b-179f-4c21-9b94-cbb0e9ae2810 tempest-ServerActionsTestOtherA-1604072392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:40 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2281d38f-c3c6-441c-9350-6a804684c0bb]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:06:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-48fc0d5c-1915-4ed5-940a-940a415634dd req-ef115c5b-179f-4c21-9b94-cbb0e9ae2810 tempest-ServerActionsTestOtherA-1604072392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:40 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 Jul 09 15:06:40 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:40 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-48fc0d5c-1915-4ed5-940a-940a415634dd req-ef115c5b-179f-4c21-9b94-cbb0e9ae2810 tempest-ServerActionsTestOtherA-1604072392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99" returned: 0 in 0.910s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-48fc0d5c-1915-4ed5-940a-940a415634dd req-ef115c5b-179f-4c21-9b94-cbb0e9ae2810 tempest-ServerActionsTestOtherA-1604072392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.931s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-48fc0d5c-1915-4ed5-940a-940a415634dd req-ef115c5b-179f-4c21-9b94-cbb0e9ae2810 tempest-ServerActionsTestOtherA-1604072392 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-5457c649-4131-4670-a07c-7ae8a57e3a99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fafc038-74f3-4c97-b68d-a9112bfe6f70', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:06:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-48fc0d5c-1915-4ed5-940a-940a415634dd req-ef115c5b-179f-4c21-9b94-cbb0e9ae2810 tempest-ServerActionsTestOtherA-1604072392 None] attachment_update completed successfully. Jul 09 15:06:51 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=26,cinder:UPDATE=13,cinder:INSERT=1 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:06:51 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=16,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:07:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:07:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:07:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:07:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:07:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:07:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:07:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:04 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:07:04 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:05 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.775s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:07:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Acquiring lock "cinder-3f39af56-e414-4254-a31f-06fe69cba0bf-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:07:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Lock "cinder-3f39af56-e414-4254-a31f-06fe69cba0bf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:07:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Acquiring lock "cinder-quobyte-3f39af56-e414-4254-a31f-06fe69cba0bf" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:07:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Lock "cinder-quobyte-3f39af56-e414-4254-a31f-06fe69cba0bf" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:07:10 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[da38281d-b81d-4459-8a53-610d84c62ec0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:07:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:10 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf Jul 09 15:07:10 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:11 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf" returned: 0 in 0.788s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:11 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf Jul 09 15:07:11 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:12 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3f39af56-e414-4254-a31f-06fe69cba0bf" returned: 0 in 0.706s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Lock "cinder-quobyte-3f39af56-e414-4254-a31f-06fe69cba0bf" released by "delete_volume" :: held 1.570s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:07:12 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Created reservations ['b29da648-7ca6-464a-bc44-ead9c282312e', '3f31a862-6773-4954-bfc6-33e7750f4cbf', '2feb8b21-3402-4ad4-816c-b1134cdff39a', '42f9d94a-5a6e-46d9-bb54-6d0ecfa528a2'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:07:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:07:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:07:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:07:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:07:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:07:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:12 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:07:12 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-cdfc7b53-fbf9-43d4-900d-944ff5c243a4 req-92ef29c2-f435-4ed9-8768-e1fcd689adfe tempest-TaggedAttachmentsTest-1225108225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:07:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-cdfc7b53-fbf9-43d4-900d-944ff5c243a4 req-92ef29c2-f435-4ed9-8768-e1fcd689adfe tempest-TaggedAttachmentsTest-1225108225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:07:13 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:13 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[95308628-4160-44a5-b96f-dec39e3a374c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:07:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-cdfc7b53-fbf9-43d4-900d-944ff5c243a4 req-92ef29c2-f435-4ed9-8768-e1fcd689adfe tempest-TaggedAttachmentsTest-1225108225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.145s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:13 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:07:13 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Deleted volume successfully. Jul 09 15:07:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-630b4828-857c-4b9d-8f8d-61880960b080 tempest-AttachVolumeShelveTestJSON-1239639239 None] Lock "cinder-3f39af56-e414-4254-a31f-06fe69cba0bf-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:07:13 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa Jul 09 15:07:13 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:13 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-cce5c5ab-158b-41e4-a874-52c10151e218 req-662e3737-3b0f-4103-b8a7-547d8fb00ade tempest-ServerActionsTestOtherA-1604072392 None] Terminate volume connection completed successfully. Jul 09 15:07:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-cce5c5ab-158b-41e4-a874-52c10151e218 req-662e3737-3b0f-4103-b8a7-547d8fb00ade tempest-ServerActionsTestOtherA-1604072392 None] Deleting attachment 8fafc038-74f3-4c97-b68d-a9112bfe6f70. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:07:14 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-cdfc7b53-fbf9-43d4-900d-944ff5c243a4 req-92ef29c2-f435-4ed9-8768-e1fcd689adfe tempest-TaggedAttachmentsTest-1225108225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa" returned: 0 in 1.243s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-cdfc7b53-fbf9-43d4-900d-944ff5c243a4 req-92ef29c2-f435-4ed9-8768-e1fcd689adfe tempest-TaggedAttachmentsTest-1225108225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.264s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:07:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-cdfc7b53-fbf9-43d4-900d-944ff5c243a4 req-92ef29c2-f435-4ed9-8768-e1fcd689adfe tempest-TaggedAttachmentsTest-1225108225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c55b16e4-d7ed-4065-b211-38e918c73316', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:07:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-cdfc7b53-fbf9-43d4-900d-944ff5c243a4 req-92ef29c2-f435-4ed9-8768-e1fcd689adfe tempest-TaggedAttachmentsTest-1225108225 None] attachment_update completed successfully. Jul 09 15:07:23 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-2d1d386b-8662-4e20-b438-df23861330aa req-7fc18bec-f857-486b-b474-c1c1fd07387c tempest-TaggedAttachmentsTest-1225108225 None] Terminate volume connection completed successfully. Jul 09 15:07:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-2d1d386b-8662-4e20-b438-df23861330aa req-7fc18bec-f857-486b-b474-c1c1fd07387c tempest-TaggedAttachmentsTest-1225108225 None] Deleting attachment c55b16e4-d7ed-4065-b211-38e918c73316. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:07:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Acquiring lock "cinder-5457c649-4131-4670-a07c-7ae8a57e3a99-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:07:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Lock "cinder-5457c649-4131-4670-a07c-7ae8a57e3a99-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:07:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Acquiring lock "cinder-quobyte-5457c649-4131-4670-a07c-7ae8a57e3a99" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:07:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Lock "cinder-quobyte-5457c649-4131-4670-a07c-7ae8a57e3a99" acquired by "delete_volume" :: waited 0.048s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:07:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[650c354a-4cf0-47d2-af59-fc1b3cebe841]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:07:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:28 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 Jul 09 15:07:28 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:29 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99" returned: 0 in 1.414s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:30 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99 Jul 09 15:07:30 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:31 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5457c649-4131-4670-a07c-7ae8a57e3a99" returned: 0 in 1.192s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Lock "cinder-quobyte-5457c649-4131-4670-a07c-7ae8a57e3a99" released by "delete_volume" :: held 2.710s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:07:31 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Created reservations ['468b7e4f-6d61-4ef6-a737-43b7c1bfe350', '54cf2c00-63c4-483b-a258-b654a5015cfb', '5e335e83-8e93-49bc-a159-a75c92ad80f3', 'e2c8da18-b984-4a18-93c8-2e81c512704f'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:07:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:07:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:07:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:07:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:07:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:07:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:31 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:07:31 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:33 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.727s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:33 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:07:33 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Deleted volume successfully. Jul 09 15:07:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-24121cdb-ac55-4a06-a2f2-51d36ffb8d73 tempest-ServerActionsTestOtherA-1604072392 None] Lock "cinder-5457c649-4131-4670-a07c-7ae8a57e3a99-delete_volume" released by "delete_volume" :: held 4.898s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:07:41 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=20,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:07:43 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=19,cinder:SELECT=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:07:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Acquiring lock "cinder-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:07:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Lock "cinder-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:07:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Acquiring lock "cinder-quobyte-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:07:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Lock "cinder-quobyte-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:07:51 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80fed41-f790-4257-a048-af2cf1e78c41]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:07:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:51 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa Jul 09 15:07:51 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:52 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa" returned: 0 in 0.977s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:52 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa Jul 09 15:07:52 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:53 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa" returned: 0 in 1.052s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Lock "cinder-quobyte-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa" released by "delete_volume" :: held 2.087s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:07:53 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Created reservations ['03add1ae-984e-47cf-a77c-f7a15d42cf21', '721870ae-f185-41ec-b2c2-c5f90b1deb35', '1f9f6f36-582d-4139-9d41-aabe79c2dc5e', '26376a8f-b830-4c33-afd1-ac82a70c0568'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:07:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:07:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:07:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:07:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:07:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:07:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:53 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:07:53 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Flow 'volume_create_manager' (21a8b962-2289-4616-9efe-3b43bf0a2473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a99f5f-9111-49e9-bed9-7ba8d608df97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a99f5f-9111-49e9-bed9-7ba8d608df97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1401830847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da524c59-ae2d-4a1c-b580-b0fd6e224438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e0906bef92a45a7baf601f0423323cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:07:55Z,use_quota=True,user_id='97798c2e0d694f02abedf011dc8c265e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7faf261a-15de-4619-99e2-4437e5d4c5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7faf261a-15de-4619-99e2-4437e5d4c5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138388e6-6ac4-41ca-8d4a-d46bf30ba73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138388e6-6ac4-41ca-8d4a-d46bf30ba73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da524c59-ae2d-4a1c-b580-b0fd6e224438', 'volume_name': 'volume-da524c59-ae2d-4a1c-b580-b0fd6e224438', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe5e4f7-5ac6-436f-a0b7-d461d8f2679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe5e4f7-5ac6-436f-a0b7-d461d8f2679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800f3b19-d094-400f-9f11-4a532b3c3d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Volume da524c59-ae2d-4a1c-b580-b0fd6e224438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da524c59-ae2d-4a1c-b580-b0fd6e224438', 'volume_size': 1} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1401830847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da524c59-ae2d-4a1c-b580-b0fd6e224438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e0906bef92a45a7baf601f0423323cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:07:55Z,use_quota=True,user_id='97798c2e0d694f02abedf011dc8c265e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Creating volume da524c59-ae2d-4a1c-b580-b0fd6e224438 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:07:55 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:07:55 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.464s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:07:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Deleted volume successfully. Jul 09 15:07:55 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438 1073741824 Jul 09 15:07:55 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97110927-6938-4aeb-9efb-c4dda1f290fb tempest-TaggedAttachmentsTest-1225108225 None] Lock "cinder-23717ae7-2e6b-4d67-a1de-3a8b1cb079aa-delete_volume" released by "delete_volume" :: held 3.938s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:07:57 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438 1073741824" returned: 0 in 2.197s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:57 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438 Jul 09 15:07:57 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:58 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438" returned: 0 in 1.060s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] <== create_volume: return (3328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:07:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.332s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:07:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800f3b19-d094-400f-9f11-4a532b3c3d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da524c59-ae2d-4a1c-b580-b0fd6e224438', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f45494e-577e-47af-8257-8406fc09eae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:58 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Volume volume-da524c59-ae2d-4a1c-b580-b0fd6e224438 (da524c59-ae2d-4a1c-b580-b0fd6e224438): created successfully Jul 09 15:07:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f45494e-577e-47af-8257-8406fc09eae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Flow 'volume_create_manager' (21a8b962-2289-4616-9efe-3b43bf0a2473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:07:58 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-40e25ee4-231d-487c-acc0-516347848f4e tempest-ServerRescueNegativeTestJSON-2092030689 None] Created volume successfully. Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Flow 'volume_create_manager' (64d3f14c-f9b5-4db9-8c2a-90db4887947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c14593-3924-4e28-8e6a-293cd7ca7f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c14593-3924-4e28-8e6a-293cd7ca7f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1748883070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004f0302-98f4-46bb-bf46-b71d296648d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35bcc5f3b5eb4fd4a0509ae4c8404129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:08:03Z,use_quota=True,user_id='50b72fac06ab47eaa6e6ec194243640c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5936618a-6423-4cf6-819f-eef1c6776509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5936618a-6423-4cf6-819f-eef1c6776509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13741def-7221-4606-a65f-57b7e1d5e47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13741def-7221-4606-a65f-57b7e1d5e47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '004f0302-98f4-46bb-bf46-b71d296648d6', 'volume_name': 'volume-004f0302-98f4-46bb-bf46-b71d296648d6', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e483e7b8-1ab0-4658-84f0-1cd615a4343c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e483e7b8-1ab0-4658-84f0-1cd615a4343c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a28022-1e43-44f1-b26c-cebc9a1eb7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:03 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Volume 004f0302-98f4-46bb-bf46-b71d296648d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-004f0302-98f4-46bb-bf46-b71d296648d6', 'volume_size': 1} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1748883070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004f0302-98f4-46bb-bf46-b71d296648d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35bcc5f3b5eb4fd4a0509ae4c8404129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:08:03Z,use_quota=True,user_id='50b72fac06ab47eaa6e6ec194243640c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Creating volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:08:03 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:08:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:03 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 1073741824 Jul 09 15:08:03 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:08:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:08:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:08:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:04 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:08:04 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:05 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 1073741824" returned: 0 in 1.657s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:05 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 Jul 09 15:08:05 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:06 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6" returned: 0 in 1.009s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] <== create_volume: return (2822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.825s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a28022-1e43-44f1-b26c-cebc9a1eb7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004f0302-98f4-46bb-bf46-b71d296648d6', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4acaaa6-b081-4a87-82bf-8baf53914602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:06 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Volume volume-004f0302-98f4-46bb-bf46-b71d296648d6 (004f0302-98f4-46bb-bf46-b71d296648d6): created successfully Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4acaaa6-b081-4a87-82bf-8baf53914602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Flow 'volume_create_manager' (64d3f14c-f9b5-4db9-8c2a-90db4887947b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:08:06 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.605s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 8 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:08:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:08:06 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c3c3de8d-2e36-45e0-9e17-291865784cea tempest-SnapshotsActionsTest-315255867 None] Created volume successfully. Jul 09 15:08:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Creating offline snapshot 7f88413a-8e76-421c-9a1c-3664c4fdcc9b of volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:08:08 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f9d47c-236c-4f0c-a570-7f767a179809]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:08 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 Jul 09 15:08:08 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:09 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6" returned: 0 in 1.149s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:09 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b 1G Jul 09 15:08:09 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:10 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b 1G" returned: 0 in 1.539s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:11 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:08:11 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:12 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 1.477s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:12 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b is being set with open permissions: ugo+rw Jul 09 15:08:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:12 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:08:12 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:13 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 1.206s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:13 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.info Jul 09 15:08:13 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:15 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.info" returned: 0 in 1.310s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:15 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.info is being set with open permissions: ugo+rw Jul 09 15:08:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:15 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.info Jul 09 15:08:15 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:16 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.info" returned: 0 in 0.951s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.830s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:16 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3d84b7d8-c807-4907-bfe2-afae9e9de19d tempest-SnapshotsActionsTest-315255867 None] Create snapshot completed successfully Jul 09 15:08:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] Creating offline snapshot 299a37ab-ce8b-474a-9895-b0aaf815e3da of volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:08:18 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75ad8a2-220c-4413-9fe3-0984a0a56cfa]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:18 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:08:18 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Acquiring lock "cinder-da524c59-ae2d-4a1c-b580-b0fd6e224438-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Lock "cinder-da524c59-ae2d-4a1c-b580-b0fd6e224438-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Acquiring lock "cinder-quobyte-da524c59-ae2d-4a1c-b580-b0fd6e224438" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Lock "cinder-quobyte-da524c59-ae2d-4a1c-b580-b0fd6e224438" acquired by "delete_volume" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:19 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e874aa-9ad1-4f8c-807c-4ff9df762958]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:19 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 1.267s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:19 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da 1G Jul 09 15:08:19 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438 Jul 09 15:08:19 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:19 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:20 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438" returned: 0 in 1.014s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:20 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438 Jul 09 15:08:20 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:20 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da 1G" returned: 0 in 1.259s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:20 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da Jul 09 15:08:20 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:21 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-da524c59-ae2d-4a1c-b580-b0fd6e224438" returned: 0 in 1.204s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Lock "cinder-quobyte-da524c59-ae2d-4a1c-b580-b0fd6e224438" released by "delete_volume" :: held 2.304s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Created reservations ['6f82411b-2544-404a-9493-5187463cc863', '09696f69-106e-4218-b652-e246c2ec30cc', '43145107-754a-4f50-a888-682c208e5443', 'f00b6797-ad89-46a4-ac23-ffeb4772dd4f'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:08:21 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da" returned: 0 in 1.087s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:21 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da is being set with open permissions: ugo+rw Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:21 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da Jul 09 15:08:21 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:21 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:08:21 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:22 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.728s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:22 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:08:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Deleted volume successfully. Jul 09 15:08:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-626c973c-c1f4-4cb2-87ba-6f543ed845ce tempest-ServerRescueNegativeTestJSON-2092030689 None] Lock "cinder-da524c59-ae2d-4a1c-b580-b0fd6e224438-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:22 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da" returned: 0 in 0.909s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.650s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7858e865-987e-4f00-a54d-ffd08549f753 tempest-SnapshotsActionsTest-315255867 None] Create snapshot completed successfully Jul 09 15:08:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-299a37ab-ce8b-474a-9895-b0aaf815e3da-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-299a37ab-ce8b-474a-9895-b0aaf815e3da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-quobyte-299a37ab-ce8b-474a-9895-b0aaf815e3da" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-299a37ab-ce8b-474a-9895-b0aaf815e3da" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Deleting offline snapshot 299a37ab-ce8b-474a-9895-b0aaf815e3da of volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:08:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] snapshot_file for this snap is: volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:08:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[590bc0ae-dae3-4f74-91f5-f7ce24409609]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:23 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da Jul 09 15:08:23 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:24 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da" returned: 0 in 1.013s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:24 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d96ea3-cf25-476e-aa99-67d81b40a24e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:25 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:08:25 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:26 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 1.791s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:26 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da Jul 09 15:08:26 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:27 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da" returned: 0 in 1.262s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:27 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da Jul 09 15:08:27 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:28 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.299a37ab-ce8b-474a-9895-b0aaf815e3da" returned: 0 in 0.823s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-299a37ab-ce8b-474a-9895-b0aaf815e3da" released by "_delete_snapshot" :: held 5.059s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" released by "delete_snapshot" :: held 5.120s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:28 devstack cinder-volume[87042]: WARNING cinder.quota [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:08:28 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Created reservations ['9238dab8-84e4-4f76-ac3c-f5d8c15a8f79', '2a3fa897-11fc-4c1f-9c2c-d49d65333415', '659370dd-ed80-492d-9d95-07ab9ac2170a', 'a678db46-81e2-49a8-ac49-ace41e803ebc'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:08:28 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Delete snapshot completed successfully. Jul 09 15:08:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d43f1efc-f6ff-41a0-9b91-592d789f32dd tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-299a37ab-ce8b-474a-9895-b0aaf815e3da-delete_snapshot" released by "delete_snapshot" :: held 5.352s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] Creating offline snapshot 5e1016b8-2304-4bd3-8845-dfc9a1568534 of volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:08:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5662813b-b1f2-4cfc-964f-e75ba1651714]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:30 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:08:30 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Flow 'volume_create_manager' (f2cd1291-df1e-41cd-b558-6f9f952af268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54874f9a-296a-4bd0-9944-f61d30d1b4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54874f9a-296a-4bd0-9944-f61d30d1b4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1792173696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f516d89e-6ef1-477e-9716-fd5cf5e47e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740f247e667d4d4fa14c443f7e9d9289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:08:31Z,use_quota=True,user_id='33f3c0dcce7246e9a3cb2ef292179f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512b2fa0-45b4-4548-b82a-1d95f12c7b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512b2fa0-45b4-4548-b82a-1d95f12c7b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a37582-0051-46a7-8109-10112938320f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a37582-0051-46a7-8109-10112938320f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f516d89e-6ef1-477e-9716-fd5cf5e47e41', 'volume_name': 'volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41678327-3bf2-4124-be29-90b14a4ef915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41678327-3bf2-4124-be29-90b14a4ef915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2032ad-93b7-4d0f-a61b-1d774322cbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:30 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Volume f516d89e-6ef1-477e-9716-fd5cf5e47e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41', 'volume_size': 1} Jul 09 15:08:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:31 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 1.162s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:31 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 1G Jul 09 15:08:31 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:31 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 1G" returned: 0 in 0.937s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:31 devstack sudo[91810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 Jul 09 15:08:31 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:32 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534" returned: 0 in 0.756s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:32 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 is being set with open permissions: ugo+rw Jul 09 15:08:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:32 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 Jul 09 15:08:32 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:33 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534" returned: 0 in 0.730s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.778s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.602s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1792173696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f516d89e-6ef1-477e-9716-fd5cf5e47e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740f247e667d4d4fa14c443f7e9d9289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:08:31Z,use_quota=True,user_id='33f3c0dcce7246e9a3cb2ef292179f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Creating volume f516d89e-6ef1-477e-9716-fd5cf5e47e41 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:08:33 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:08:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:33 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 1073741824 Jul 09 15:08:33 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:33 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-28454af9-7e5f-4b06-a780-7e131494a14a tempest-SnapshotsActionsTest-315255867 None] Create snapshot completed successfully Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-5e1016b8-2304-4bd3-8845-dfc9a1568534-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-5e1016b8-2304-4bd3-8845-dfc9a1568534-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-quobyte-5e1016b8-2304-4bd3-8845-dfc9a1568534" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-5e1016b8-2304-4bd3-8845-dfc9a1568534" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Deleting offline snapshot 5e1016b8-2304-4bd3-8845-dfc9a1568534 of volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] snapshot_file for this snap is: volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c410f9-d1ef-4c3b-a1ee-d233e6a64f36]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:34 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 Jul 09 15:08:34 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:34 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 1073741824" returned: 0 in 1.337s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:34 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 Jul 09 15:08:34 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:35 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534" returned: 0 in 0.984s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[694291d0-837f-44b0-9ef9-7601d896e1c4]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:35 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:08:35 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:35 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41" returned: 0 in 0.785s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2032ad-93b7-4d0f-a61b-1d774322cbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c79dd0c-4fc8-4aeb-8883-ae5684401ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:35 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Volume volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 (f516d89e-6ef1-477e-9716-fd5cf5e47e41): created successfully Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c79dd0c-4fc8-4aeb-8883-ae5684401ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Flow 'volume_create_manager' (f2cd1291-df1e-41cd-b558-6f9f952af268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:08:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b00d2c0b-aa9e-46d9-9ee4-4cbc285e4056 tempest-AttachVolumeTestJSON-2101523604 None] Created volume successfully. Jul 09 15:08:36 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 0.813s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:36 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 Jul 09 15:08:36 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:37 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534" returned: 0 in 0.805s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:37 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534 Jul 09 15:08:37 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:37 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.5e1016b8-2304-4bd3-8845-dfc9a1568534" returned: 0 in 0.691s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-5e1016b8-2304-4bd3-8845-dfc9a1568534" released by "_delete_snapshot" :: held 3.411s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" released by "delete_snapshot" :: held 3.444s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:37 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Created reservations ['8d515ee2-be47-49e4-b8a7-3b8ab5758302', 'dfc5043b-6936-417e-a262-fee476ffa7e4', '24d6714e-d2cb-49de-9723-917adf4331e6', '23d7d285-caf9-4e9a-a238-76ced3646f78'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:08:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Delete snapshot completed successfully. Jul 09 15:08:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e7776ac1-136c-45a4-968d-880619aa9c38 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-5e1016b8-2304-4bd3-8845-dfc9a1568534-delete_snapshot" released by "delete_snapshot" :: held 3.594s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] Creating offline snapshot 1c4be364-54f0-4522-a22c-80401f39e79d of volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:08:39 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdb2bab-088f-43bd-a0fd-cc0f18ae4385]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-4e405a6b-854d-4a68-bd50-46bb31dba8c3 req-d52efeb2-4756-47c3-9d79-8b3fe37ff418 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:39 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:08:39 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:39 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 0.885s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:39 devstack sudo[91897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d 1G Jul 09 15:08:39 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:41 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d 1G" returned: 0 in 1.214s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:41 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d Jul 09 15:08:41 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:42 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d" returned: 0 in 0.869s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:42 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d is being set with open permissions: ugo+rw Jul 09 15:08:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:42 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d Jul 09 15:08:42 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:42 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d" returned: 0 in 0.877s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:42 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=37,cinder:UPDATE=46,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:08:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.973s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-4e405a6b-854d-4a68-bd50-46bb31dba8c3 req-d52efeb2-4756-47c3-9d79-8b3fe37ff418 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.876s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:42 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[911e0217-1623-4f1f-bc3e-9cc285722f20]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-4e405a6b-854d-4a68-bd50-46bb31dba8c3 req-d52efeb2-4756-47c3-9d79-8b3fe37ff418 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:43 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-676346c7-0c6f-44f4-9ee6-e9622be8774f tempest-SnapshotsActionsTest-315255867 None] Create snapshot completed successfully Jul 09 15:08:43 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 Jul 09 15:08:43 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-1c4be364-54f0-4522-a22c-80401f39e79d-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-1c4be364-54f0-4522-a22c-80401f39e79d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-quobyte-1c4be364-54f0-4522-a22c-80401f39e79d" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-1c4be364-54f0-4522-a22c-80401f39e79d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Deleting offline snapshot 1c4be364-54f0-4522-a22c-80401f39e79d of volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] snapshot_file for this snap is: volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[66de3fe5-ac94-4ed3-910d-883158142342]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:43 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d Jul 09 15:08:43 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:43 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-4e405a6b-854d-4a68-bd50-46bb31dba8c3 req-d52efeb2-4756-47c3-9d79-8b3fe37ff418 tempest-AttachVolumeTestJSON-2101523604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41" returned: 0 in 0.890s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-4e405a6b-854d-4a68-bd50-46bb31dba8c3 req-d52efeb2-4756-47c3-9d79-8b3fe37ff418 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=36,cinder:SELECT=39,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:08:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-4e405a6b-854d-4a68-bd50-46bb31dba8c3 req-d52efeb2-4756-47c3-9d79-8b3fe37ff418 tempest-AttachVolumeTestJSON-2101523604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd87a5297-461b-4b97-9964-5bf7d3dc4da6', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:08:44 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-4e405a6b-854d-4a68-bd50-46bb31dba8c3 req-d52efeb2-4756-47c3-9d79-8b3fe37ff418 tempest-AttachVolumeTestJSON-2101523604 None] attachment_update completed successfully. Jul 09 15:08:44 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d" returned: 0 in 0.952s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:44 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85e94af-4e50-4eac-93bd-54f50e74512b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:44 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:08:44 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:45 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 0.876s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:45 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d Jul 09 15:08:45 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:46 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d" returned: 0 in 1.119s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:46 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d Jul 09 15:08:46 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:47 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.1c4be364-54f0-4522-a22c-80401f39e79d" returned: 0 in 0.899s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-1c4be364-54f0-4522-a22c-80401f39e79d" released by "_delete_snapshot" :: held 3.963s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" released by "delete_snapshot" :: held 3.991s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:47 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Created reservations ['2e3344ea-2124-4d78-9abb-446cccb87d89', 'f8fd51fb-f5ee-434a-b334-d83aa5386765', 'feee0086-5cb9-4809-a4ac-2081ff7fbe50', '8762ae67-ab1b-4ad1-889a-cff8988888f6'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:08:47 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Delete snapshot completed successfully. Jul 09 15:08:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0aa6571a-bf8d-4209-a6e8-c383420d1305 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-1c4be364-54f0-4522-a22c-80401f39e79d-delete_snapshot" released by "delete_snapshot" :: held 4.131s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] Creating offline snapshot 9e1080e2-e62c-4590-b0b8-190be74e1671 of volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:08:48 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f090f9e3-5de1-405d-9708-1a62ebaa10df]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:48 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:08:48 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:49 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 1.415s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:49 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 1G Jul 09 15:08:49 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 1G" returned: 0 in 1.466s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:51 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:51 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 Jul 09 15:08:51 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:52 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671" returned: 0 in 1.178s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:52 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 is being set with open permissions: ugo+rw Jul 09 15:08:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:52 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 Jul 09 15:08:52 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:53 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671" returned: 0 in 0.968s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.154s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:53 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-36e3782f-8e85-4461-9ec2-b3c81cca88a8 tempest-SnapshotsActionsTest-315255867 None] Create snapshot completed successfully Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-9e1080e2-e62c-4590-b0b8-190be74e1671-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-9e1080e2-e62c-4590-b0b8-190be74e1671-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Acquiring lock "cinder-quobyte-9e1080e2-e62c-4590-b0b8-190be74e1671" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-9e1080e2-e62c-4590-b0b8-190be74e1671" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Deleting offline snapshot 9e1080e2-e62c-4590-b0b8-190be74e1671 of volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] snapshot_file for this snap is: volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99bd85b-0883-46ba-b57c-a636c111c1c7]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:54 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 Jul 09 15:08:54 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:55 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671" returned: 0 in 1.184s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:55 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d3b4a-bf51-483d-9c1a-8c252d44cb53]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:55 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:08:55 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:56 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 1.081s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:08:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:56 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 Jul 09 15:08:56 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:57 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671" returned: 0 in 1.251s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:57 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671 Jul 09 15:08:57 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:58 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.9e1080e2-e62c-4590-b0b8-190be74e1671" returned: 0 in 1.176s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-9e1080e2-e62c-4590-b0b8-190be74e1671" released by "_delete_snapshot" :: held 4.862s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" released by "delete_snapshot" :: held 4.908s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:58 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Created reservations ['109a7b6a-2401-4ea4-bde5-325672457013', '8b5a2710-6b09-4b80-8a49-6e83eea79998', '6839a5e3-e535-4dd8-91a2-b76a6b206b7e', '7e8427ae-5066-40e1-b3a7-050e573550a6'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:08:58 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Delete snapshot completed successfully. Jul 09 15:08:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a06b71bf-0035-43ca-8d2d-dd51e30ba3b8 tempest-SnapshotsActionsTest-1660160143 None] Lock "cinder-9e1080e2-e62c-4590-b0b8-190be74e1671-delete_snapshot" released by "delete_snapshot" :: held 5.156s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "cinder-7f88413a-8e76-421c-9a1c-3664c4fdcc9b-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Lock "cinder-7f88413a-8e76-421c-9a1c-3664c4fdcc9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "cinder-quobyte-7f88413a-8e76-421c-9a1c-3664c4fdcc9b" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Lock "cinder-quobyte-7f88413a-8e76-421c-9a1c-3664c4fdcc9b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Deleting offline snapshot 7f88413a-8e76-421c-9a1c-3664c4fdcc9b of volume 004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:09:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] snapshot_file for this snap is: volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:09:00 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[de47b3a7-6a06-4386-abae-3a14be396375]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:09:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:00 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:09:00 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:00 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 0.808s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004f0302-98f4-46bb-bf46-b71d296648d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:09:00 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfa98f1-6759-4d5a-a6a4-5e8e631e1576]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:09:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:01 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 Jul 09 15:09:01 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:01 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6" returned: 0 in 1.104s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:02 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:09:02 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:02 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 0.797s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:02 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b Jul 09 15:09:02 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:03 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6.7f88413a-8e76-421c-9a1c-3664c4fdcc9b" returned: 0 in 0.663s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Lock "cinder-quobyte-7f88413a-8e76-421c-9a1c-3664c4fdcc9b" released by "_delete_snapshot" :: held 3.472s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" released by "delete_snapshot" :: held 3.498s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:03 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Created reservations ['644be1a5-dbeb-47ff-a0c4-f712e66bd577', '03fb42fc-096a-4972-bb2a-14a9162e850c', 'ffea0646-00fb-4387-8e3e-984f469afb7c', '2ae2e394-19dd-43f7-af3f-f1f7eaebac45'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:09:03 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Delete snapshot completed successfully. Jul 09 15:09:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-58b71318-502d-4fe5-81b0-928d005731b2 tempest-SnapshotsActionsTest-315255867 None] Lock "cinder-7f88413a-8e76-421c-9a1c-3664c4fdcc9b-delete_snapshot" released by "delete_snapshot" :: held 3.631s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "cinder-004f0302-98f4-46bb-bf46-b71d296648d6-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Lock "cinder-004f0302-98f4-46bb-bf46-b71d296648d6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fede27-e87f-4e35-a4cb-a9eaa72eb6c4]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:04 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 Jul 09 15:09:04 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:04 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:09:04 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:05 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6" returned: 0 in 1.522s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:05 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6 Jul 09 15:09:05 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:06 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.222s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:06 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:09:06 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:09:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 8 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:09:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:09:07 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-004f0302-98f4-46bb-bf46-b71d296648d6" returned: 0 in 1.214s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Lock "cinder-quobyte-004f0302-98f4-46bb-bf46-b71d296648d6" released by "delete_volume" :: held 2.822s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:07 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Created reservations ['e3f8abce-44c3-4a2e-bec2-b4c793a465a2', 'a95c7f8f-f016-4524-a551-cc53dea04d4f', 'ee0c4014-c2a9-4b36-a941-bdd8b15eabf8', '47c78f8d-c494-4044-9c9c-c5bf714b3902'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:09:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:07 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:09:07 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:08 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.214s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:08 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:09:08 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Deleted volume successfully. Jul 09 15:09:08 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e24ecc60-00c0-4ff9-863a-0460f2ddc53c tempest-SnapshotsActionsTest-315255867 None] Lock "cinder-004f0302-98f4-46bb-bf46-b71d296648d6-delete_volume" released by "delete_volume" :: held 4.406s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:DELETE=1,cinder:SELECT=27,cinder:UPDATE=21,cinder:INSERT=9 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Flow 'volume_create_manager' (ac7a68d4-2c63-4542-bf0a-b19c99a56e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4834c6ab-4675-4ed5-a1e3-da48a99bb30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4834c6ab-4675-4ed5-a1e3-da48a99bb30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-421913999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbfc38da-bdaa-4468-ac39-ce4c40c473f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162fc8e028e549f5a23d2a0f609f7ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:18Z,use_quota=True,user_id='27fa6a2d907543d2a31f40aa5297b26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd6d8cc-9919-405c-8e67-eeadd797a261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd6d8cc-9919-405c-8e67-eeadd797a261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3aa3c7-e007-4ae9-8612-65e6f1d9dcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3aa3c7-e007-4ae9-8612-65e6f1d9dcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbfc38da-bdaa-4468-ac39-ce4c40c473f7', 'volume_name': 'volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59585cf2-5065-4b15-a383-b3fec8ab2a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59585cf2-5065-4b15-a383-b3fec8ab2a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b9af76-ab9e-474d-a655-f08744c9d75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:17 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Volume cbfc38da-bdaa-4468-ac39-ce4c40c473f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7', 'volume_size': 1} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-421913999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbfc38da-bdaa-4468-ac39-ce4c40c473f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162fc8e028e549f5a23d2a0f609f7ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:18Z,use_quota=True,user_id='27fa6a2d907543d2a31f40aa5297b26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Creating volume cbfc38da-bdaa-4468-ac39-ce4c40c473f7 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:09:17 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:09:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:17 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 1073741824 Jul 09 15:09:17 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:19 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 1073741824" returned: 0 in 1.569s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:19 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 Jul 09 15:09:19 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:20 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7" returned: 0 in 1.010s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] <== create_volume: return (2706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:09:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.712s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b9af76-ab9e-474d-a655-f08744c9d75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6edae5-c7df-45e1-a7bf-40c137cfd937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:20 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Volume volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 (cbfc38da-bdaa-4468-ac39-ce4c40c473f7): created successfully Jul 09 15:09:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6edae5-c7df-45e1-a7bf-40c137cfd937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Flow 'volume_create_manager' (ac7a68d4-2c63-4542-bf0a-b19c99a56e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:20 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-4cf9be42-0576-474e-a7cb-274e0df09576 tempest-AttachVolumeNegativeTest-2087590681 None] Created volume successfully. Jul 09 15:09:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-2af5665a-532b-4647-8fb3-ce19a8b1c81f req-4b1fcc72-1841-4e8e-9981-63dd83a6b7d6 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-2af5665a-532b-4647-8fb3-ce19a8b1c81f req-4b1fcc72-1841-4e8e-9981-63dd83a6b7d6 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:24 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa90a13-7edb-4245-bee3-5d1fcfeaf780]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:09:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2af5665a-532b-4647-8fb3-ce19a8b1c81f req-4b1fcc72-1841-4e8e-9981-63dd83a6b7d6 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:24 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 Jul 09 15:09:24 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:25 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2af5665a-532b-4647-8fb3-ce19a8b1c81f req-4b1fcc72-1841-4e8e-9981-63dd83a6b7d6 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7" returned: 0 in 0.913s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-2af5665a-532b-4647-8fb3-ce19a8b1c81f req-4b1fcc72-1841-4e8e-9981-63dd83a6b7d6 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.934s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-2af5665a-532b-4647-8fb3-ce19a8b1c81f req-4b1fcc72-1841-4e8e-9981-63dd83a6b7d6 tempest-AttachVolumeNegativeTest-2087590681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5ee8239-8871-4239-94ae-4a66a391982d', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:09:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-2af5665a-532b-4647-8fb3-ce19a8b1c81f req-4b1fcc72-1841-4e8e-9981-63dd83a6b7d6 tempest-AttachVolumeNegativeTest-2087590681 None] attachment_update completed successfully. Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Flow 'volume_create_manager' (a69c5681-54e7-40e3-a965-b4e8b389a492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3691321-9f3a-4581-bf1f-0cf550e2b4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3691321-9f3a-4581-bf1f-0cf550e2b4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1766783092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb61c8b1-7e94-4d2f-b852-8bc988419523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53dad990e21a4b708d7e877f06db593b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:25Z,use_quota=True,user_id='eb8705f8c0ba46708f105bd24033eddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3490da54-595b-45ed-8f04-a577d07e5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3490da54-595b-45ed-8f04-a577d07e5088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e88dad6-3928-4326-8f14-930cb84b6a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e88dad6-3928-4326-8f14-930cb84b6a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb61c8b1-7e94-4d2f-b852-8bc988419523', 'volume_name': 'volume-eb61c8b1-7e94-4d2f-b852-8bc988419523', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5634838e-d188-4888-8044-6b181835b0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5634838e-d188-4888-8044-6b181835b0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9eab575-cb32-48c0-9165-cdb46c9709b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:25 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Volume eb61c8b1-7e94-4d2f-b852-8bc988419523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb61c8b1-7e94-4d2f-b852-8bc988419523', 'volume_size': 1} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1766783092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb61c8b1-7e94-4d2f-b852-8bc988419523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53dad990e21a4b708d7e877f06db593b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:25Z,use_quota=True,user_id='eb8705f8c0ba46708f105bd24033eddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Creating volume eb61c8b1-7e94-4d2f-b852-8bc988419523 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:09:25 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:09:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:25 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523 1073741824 Jul 09 15:09:25 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:26 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523 1073741824" returned: 0 in 1.202s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:26 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523 Jul 09 15:09:26 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:27 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523" returned: 0 in 0.977s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:09:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9eab575-cb32-48c0-9165-cdb46c9709b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb61c8b1-7e94-4d2f-b852-8bc988419523', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349c2c70-1551-45f3-afb0-b38cf7082c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:27 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Volume volume-eb61c8b1-7e94-4d2f-b852-8bc988419523 (eb61c8b1-7e94-4d2f-b852-8bc988419523): created successfully Jul 09 15:09:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349c2c70-1551-45f3-afb0-b38cf7082c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Flow 'volume_create_manager' (a69c5681-54e7-40e3-a965-b4e8b389a492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:27 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-5ea766b3-d76d-47c6-b014-b9d856cf8c6b tempest-VolumeQuotasAdminTestJSON-1029320330 None] Created volume successfully. Jul 09 15:09:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Acquiring lock "cinder-eb61c8b1-7e94-4d2f-b852-8bc988419523-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "cinder-eb61c8b1-7e94-4d2f-b852-8bc988419523-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Acquiring lock "cinder-quobyte-eb61c8b1-7e94-4d2f-b852-8bc988419523" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "cinder-quobyte-eb61c8b1-7e94-4d2f-b852-8bc988419523" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[868c1f18-eb84-4d72-b927-a871c6faff35]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:09:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:29 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523 Jul 09 15:09:29 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:29 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523" returned: 0 in 0.966s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:29 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523 Jul 09 15:09:29 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:30 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-eb61c8b1-7e94-4d2f-b852-8bc988419523" returned: 0 in 0.710s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "cinder-quobyte-eb61c8b1-7e94-4d2f-b852-8bc988419523" released by "delete_volume" :: held 1.727s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:30 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Created reservations ['56894adb-5d0d-476a-8827-0399a6e48eb2', 'a373a14e-1830-465a-a94a-77a13a4143f7', 'f875d39c-9f92-4ca4-bfd0-d3c2b84d5980', '60573cde-be18-4c53-a2db-f2673e424500'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:09:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:30 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:09:30 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:31 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-fd11f065-0432-4c93-b2f0-1d3a19f9be7e req-69f1177c-548f-43ef-86b0-49e33c140681 tempest-AttachVolumeTestJSON-2101523604 None] Terminate volume connection completed successfully. Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-fd11f065-0432-4c93-b2f0-1d3a19f9be7e req-69f1177c-548f-43ef-86b0-49e33c140681 tempest-AttachVolumeTestJSON-2101523604 None] Deleting attachment d87a5297-461b-4b97-9964-5bf7d3dc4da6. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:09:31 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.759s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:09:31 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Deleted volume successfully. Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8603929b-68dd-4e52-82c6-9c047cc34f24 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "cinder-eb61c8b1-7e94-4d2f-b852-8bc988419523-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Flow 'volume_create_manager' (1d2b00ae-980b-446d-96b0-6fe6af5a683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69f5d61-0faf-473d-aecc-98901c403872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69f5d61-0faf-473d-aecc-98901c403872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-83564289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38325d8-78f8-4158-b8eb-c022df23f51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53dad990e21a4b708d7e877f06db593b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:32Z,use_quota=True,user_id='eb8705f8c0ba46708f105bd24033eddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c2d53a-48a7-4d9a-808c-557b7069c348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c2d53a-48a7-4d9a-808c-557b7069c348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5025c2cd-5bf6-4a86-97d8-0ba94e3c83ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5025c2cd-5bf6-4a86-97d8-0ba94e3c83ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38325d8-78f8-4158-b8eb-c022df23f51d', 'volume_name': 'volume-a38325d8-78f8-4158-b8eb-c022df23f51d', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c77737a-d79f-4af7-a009-3efa3012f2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c77737a-d79f-4af7-a009-3efa3012f2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844ea72f-260d-4773-aac1-7139da53b7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:31 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Volume a38325d8-78f8-4158-b8eb-c022df23f51d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38325d8-78f8-4158-b8eb-c022df23f51d', 'volume_size': 1} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-83564289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38325d8-78f8-4158-b8eb-c022df23f51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53dad990e21a4b708d7e877f06db593b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:32Z,use_quota=True,user_id='eb8705f8c0ba46708f105bd24033eddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Creating volume a38325d8-78f8-4158-b8eb-c022df23f51d {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:09:31 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:09:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:32 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d 1073741824 Jul 09 15:09:32 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:33 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d 1073741824" returned: 0 in 1.117s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:33 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d Jul 09 15:09:33 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:34 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d" returned: 0 in 1.000s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:09:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844ea72f-260d-4773-aac1-7139da53b7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38325d8-78f8-4158-b8eb-c022df23f51d', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fb8230-55f2-43eb-b5cb-cefb1d2c001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:34 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Volume volume-a38325d8-78f8-4158-b8eb-c022df23f51d (a38325d8-78f8-4158-b8eb-c022df23f51d): created successfully Jul 09 15:09:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fb8230-55f2-43eb-b5cb-cefb1d2c001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Flow 'volume_create_manager' (1d2b00ae-980b-446d-96b0-6fe6af5a683f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-53b5b100-188e-486e-98cf-d80a58a17043 tempest-VolumeQuotasAdminTestJSON-1029320330 None] Created volume successfully. Jul 09 15:09:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-64782ef9-4e6c-4708-a718-5bc315807a07 tempest-VolumeQuotasAdminTestJSON-349414513 None] Transfer volume completed successfully. Jul 09 15:09:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Acquiring lock "cinder-a38325d8-78f8-4158-b8eb-c022df23f51d-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Lock "cinder-a38325d8-78f8-4158-b8eb-c022df23f51d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Acquiring lock "cinder-quobyte-a38325d8-78f8-4158-b8eb-c022df23f51d" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Lock "cinder-quobyte-a38325d8-78f8-4158-b8eb-c022df23f51d" acquired by "delete_volume" :: waited 0.036s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:37 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7918f71b-85e7-4348-bb0f-5037a5699c1e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:09:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:37 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d Jul 09 15:09:37 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:38 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d" returned: 0 in 0.862s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:38 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d Jul 09 15:09:38 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:38 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a38325d8-78f8-4158-b8eb-c022df23f51d" returned: 0 in 0.734s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Lock "cinder-quobyte-a38325d8-78f8-4158-b8eb-c022df23f51d" released by "delete_volume" :: held 1.692s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:39 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Created reservations ['ef1a36b8-1c42-4eb1-8186-60d0ce0c8894', '1329136a-6f74-4d11-94df-b36e9dd1b91d', '16253598-aced-44cd-bb19-9b7fa9716212', '78b9bc5a-52f3-4eaa-84fc-495307d7005a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:09:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:39 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:09:39 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:40 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.261s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:40 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:09:40 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Deleted volume successfully. Jul 09 15:09:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f14ff574-ea45-4008-8a21-4349f99c624b tempest-VolumeQuotasAdminTestJSON-711163406 None] Lock "cinder-a38325d8-78f8-4158-b8eb-c022df23f51d-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Flow 'volume_create_manager' (9e5bf236-8e81-48c0-ba86-a9a0c996ed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc91eed9-9e0a-4d42-8c9e-a2a1c9dda89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=60,cinder:SELECT=52,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc91eed9-9e0a-4d42-8c9e-a2a1c9dda89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-261627522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1350b60f-2171-4867-8ec7-b728a772a1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828454cb6f2e4e6e8fc34c798416c71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:48Z,use_quota=True,user_id='32ede196f7ba42e19fb5913f8455663a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9639295b-c27d-4794-aa87-e69c9c1d39ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9639295b-c27d-4794-aa87-e69c9c1d39ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe2dd61-629f-4d31-8dd3-de789c2e1a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe2dd61-629f-4d31-8dd3-de789c2e1a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1350b60f-2171-4867-8ec7-b728a772a1dc', 'volume_name': 'volume-1350b60f-2171-4867-8ec7-b728a772a1dc', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedead9d-fd69-45d6-b7d5-2c4c0d2cc6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedead9d-fd69-45d6-b7d5-2c4c0d2cc6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5c82af-46d2-43d6-b880-0406e4dbf468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:48 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Volume 1350b60f-2171-4867-8ec7-b728a772a1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1350b60f-2171-4867-8ec7-b728a772a1dc', 'volume_size': 1} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-261627522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1350b60f-2171-4867-8ec7-b728a772a1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828454cb6f2e4e6e8fc34c798416c71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:48Z,use_quota=True,user_id='32ede196f7ba42e19fb5913f8455663a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Creating volume 1350b60f-2171-4867-8ec7-b728a772a1dc {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:09:48 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:09:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:48 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc 1073741824 Jul 09 15:09:48 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:49 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc 1073741824" returned: 0 in 1.356s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:49 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc Jul 09 15:09:49 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:51 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc" returned: 0 in 1.203s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] <== create_volume: return (2662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.665s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5c82af-46d2-43d6-b880-0406e4dbf468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1350b60f-2171-4867-8ec7-b728a772a1dc', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3879ac1d-0937-4877-870a-7777dc6f5ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:51 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Volume volume-1350b60f-2171-4867-8ec7-b728a772a1dc (1350b60f-2171-4867-8ec7-b728a772a1dc): created successfully Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3879ac1d-0937-4877-870a-7777dc6f5ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Flow 'volume_create_manager' (9e5bf236-8e81-48c0-ba86-a9a0c996ed50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:51 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b6a011af-240f-4750-a936-3770ff459f69 tempest-ServersNegativeTestJSON-1060915 None] Created volume successfully. Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Flow 'volume_create_manager' (11ed9520-c325-42a1-a3c5-9769cbccd073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff69c7-9953-4c34-bb88-32efd5071bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff69c7-9953-4c34-bb88-32efd5071bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1771667319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec18830-e7a9-4c2d-8065-f979e9869bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1157c53be1474be99cbb9d97b0f8d88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:51Z,use_quota=True,user_id='56f8e89a70de4ab3b3d7329bbdcbfcea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23d1b49-1c21-476c-b5df-2c1ae295606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23d1b49-1c21-476c-b5df-2c1ae295606e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02d324e-963c-4088-8caf-84440a29b96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02d324e-963c-4088-8caf-84440a29b96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec18830-e7a9-4c2d-8065-f979e9869bba', 'volume_name': 'volume-2ec18830-e7a9-4c2d-8065-f979e9869bba', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956fb4f1-3126-4dd2-8ef3-fa637dec5b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956fb4f1-3126-4dd2-8ef3-fa637dec5b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757083a1-1a14-4491-8fa8-0955e0e81fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:51 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Volume 2ec18830-e7a9-4c2d-8065-f979e9869bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec18830-e7a9-4c2d-8065-f979e9869bba', 'volume_size': 1} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1771667319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec18830-e7a9-4c2d-8065-f979e9869bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1157c53be1474be99cbb9d97b0f8d88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:51Z,use_quota=True,user_id='56f8e89a70de4ab3b3d7329bbdcbfcea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Creating volume 2ec18830-e7a9-4c2d-8065-f979e9869bba {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:09:51 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:09:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:51 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba 1073741824 Jul 09 15:09:51 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:53 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba 1073741824" returned: 0 in 2.125s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:53 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba Jul 09 15:09:53 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:54 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:09:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Flow 'volume_create_manager' (45f7925e-3778-4491-a046-0683d4339ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fe9c8a-9df6-4e2d-8e06-76d6696f65dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fe9c8a-9df6-4e2d-8e06-76d6696f65dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1239348288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b9f325-936a-4c7f-a2fb-25f9f7248129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828454cb6f2e4e6e8fc34c798416c71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:55Z,use_quota=True,user_id='32ede196f7ba42e19fb5913f8455663a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9416f16-2af1-4c76-9f7b-ff6d7cceb092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9416f16-2af1-4c76-9f7b-ff6d7cceb092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:54 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5650b985-7e20-45b7-8ec9-1c6153b384f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5650b985-7e20-45b7-8ec9-1c6153b384f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b9f325-936a-4c7f-a2fb-25f9f7248129', 'volume_name': 'volume-36b9f325-936a-4c7f-a2fb-25f9f7248129', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baea683-f2a2-4a60-9413-a8e1de9e6af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baea683-f2a2-4a60-9413-a8e1de9e6af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653a139b-7aa3-4d54-89ba-9da86bd6f6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Volume 36b9f325-936a-4c7f-a2fb-25f9f7248129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b9f325-936a-4c7f-a2fb-25f9f7248129', 'volume_size': 1} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba" returned: 0 in 1.394s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] <== create_volume: return (3679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.682s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1239348288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b9f325-936a-4c7f-a2fb-25f9f7248129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828454cb6f2e4e6e8fc34c798416c71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:55Z,use_quota=True,user_id='32ede196f7ba42e19fb5913f8455663a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Creating volume 36b9f325-936a-4c7f-a2fb-25f9f7248129 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:09:55 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757083a1-1a14-4491-8fa8-0955e0e81fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec18830-e7a9-4c2d-8065-f979e9869bba', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:55 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129 1073741824 Jul 09 15:09:55 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d51cdc-2efe-40a5-bcd4-a0b5e9df9e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Volume volume-2ec18830-e7a9-4c2d-8065-f979e9869bba (2ec18830-e7a9-4c2d-8065-f979e9869bba): created successfully Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d51cdc-2efe-40a5-bcd4-a0b5e9df9e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Flow 'volume_create_manager' (11ed9520-c325-42a1-a3c5-9769cbccd073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2264299f-7ae6-4430-b42c-c96fabcb6d73 tempest-VolumesServicesTestJSON-450192353 None] Created volume successfully. Jul 09 15:09:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Acquiring lock "cinder-2ec18830-e7a9-4c2d-8065-f979e9869bba-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Lock "cinder-2ec18830-e7a9-4c2d-8065-f979e9869bba-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Acquiring lock "cinder-quobyte-2ec18830-e7a9-4c2d-8065-f979e9869bba" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Lock "cinder-quobyte-2ec18830-e7a9-4c2d-8065-f979e9869bba" acquired by "delete_volume" :: waited 0.037s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:56 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e681d7-af71-419e-b3c9-5f8afc6c3121]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:09:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:56 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba Jul 09 15:09:56 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:56 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129 1073741824" returned: 0 in 1.482s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:56 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129 Jul 09 15:09:56 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:57 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba" returned: 0 in 1.131s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:57 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba Jul 09 15:09:57 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:57 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129" returned: 0 in 0.929s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] <== create_volume: return (2491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:09:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.500s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653a139b-7aa3-4d54-89ba-9da86bd6f6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b9f325-936a-4c7f-a2fb-25f9f7248129', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c24c7d-749d-4948-a713-f24cf83f2c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:57 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Volume volume-36b9f325-936a-4c7f-a2fb-25f9f7248129 (36b9f325-936a-4c7f-a2fb-25f9f7248129): created successfully Jul 09 15:09:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c24c7d-749d-4948-a713-f24cf83f2c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Flow 'volume_create_manager' (45f7925e-3778-4491-a046-0683d4339ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:57 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-cc50442d-55b8-4ab3-83b4-1e0ef5005c87 tempest-ServersNegativeTestJSON-1060915 None] Created volume successfully. Jul 09 15:09:58 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ec18830-e7a9-4c2d-8065-f979e9869bba" returned: 0 in 0.861s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Lock "cinder-quobyte-2ec18830-e7a9-4c2d-8065-f979e9869bba" released by "delete_volume" :: held 2.051s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Created reservations ['6a2b5307-30e1-47f7-b15e-70c6844c0056', 'f57efabc-0577-4d04-a9c7-8a9e93c022df', '408b9d6b-d577-4400-9887-9c7ea69d66bb', '1e409215-ec3c-4f7a-b97a-f53fe1251b28'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:58 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:09:58 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Acquiring lock "cinder-36b9f325-936a-4c7f-a2fb-25f9f7248129-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Lock "cinder-36b9f325-936a-4c7f-a2fb-25f9f7248129-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Acquiring lock "cinder-quobyte-36b9f325-936a-4c7f-a2fb-25f9f7248129" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Lock "cinder-quobyte-36b9f325-936a-4c7f-a2fb-25f9f7248129" acquired by "delete_volume" :: waited 0.033s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:59 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6fc41-4a67-4db9-800f-c6f3c0f2bada]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:09:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:59 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129 Jul 09 15:09:59 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:59 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.413s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:59 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:09:59 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Deleted volume successfully. Jul 09 15:09:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-216c2312-e444-43dd-aa05-36d957476059 tempest-VolumesServicesTestJSON-450192353 None] Lock "cinder-2ec18830-e7a9-4c2d-8065-f979e9869bba-delete_volume" released by "delete_volume" :: held 3.960s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:00 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129" returned: 0 in 1.207s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:00 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129 Jul 09 15:10:00 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:01 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36b9f325-936a-4c7f-a2fb-25f9f7248129" returned: 0 in 0.759s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Lock "cinder-quobyte-36b9f325-936a-4c7f-a2fb-25f9f7248129" released by "delete_volume" :: held 2.034s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Created reservations ['e06395d3-552b-4091-9fb9-325e4bdb1ef7', 'f8379e71-b068-448d-946a-44c08b3a46b2', 'f180eeb4-4f46-4c04-8900-7ee1d26d418f', 'e9220324-0018-4087-9e56-47adefc26021'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:01 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:10:01 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Acquiring lock "cinder-1350b60f-2171-4867-8ec7-b728a772a1dc-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Lock "cinder-1350b60f-2171-4867-8ec7-b728a772a1dc-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Acquiring lock "cinder-quobyte-1350b60f-2171-4867-8ec7-b728a772a1dc" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Lock "cinder-quobyte-1350b60f-2171-4867-8ec7-b728a772a1dc" acquired by "delete_volume" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf54838-6a6d-47cb-8a6b-c46c0988c7ba]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:01 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc Jul 09 15:10:01 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:02 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.030s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:02 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:02 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Deleted volume successfully. Jul 09 15:10:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-efe6fe24-1dac-4017-ab5b-dd4d39fcbecf tempest-ServersNegativeTestJSON-1060915 None] Lock "cinder-36b9f325-936a-4c7f-a2fb-25f9f7248129-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:02 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc" returned: 0 in 0.942s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:02 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc Jul 09 15:10:02 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:03 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1350b60f-2171-4867-8ec7-b728a772a1dc" returned: 0 in 0.699s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Lock "cinder-quobyte-1350b60f-2171-4867-8ec7-b728a772a1dc" released by "delete_volume" :: held 1.702s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:03 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Created reservations ['91294a97-9fa6-46a2-8bcc-e5d045c95c13', '298ec464-d2e6-45c2-b14d-f943b1054acb', '743d46ad-b8e8-4161-b8a4-961f17431722', 'fd724cf7-f5ad-4530-b26f-3f00bf52601b'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:03 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:10:03 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:04 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.873s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:04 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:04 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Deleted volume successfully. Jul 09 15:10:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3a1c6a4-7da5-452d-b244-a7659582fb2d tempest-ServersNegativeTestJSON-1060915 None] Lock "cinder-1350b60f-2171-4867-8ec7-b728a772a1dc-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:10:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:04 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:10:04 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:05 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.656s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:10:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 8 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:10:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Flow 'volume_create_manager' (ab1fd453-8bf7-4d79-a5ff-566750ea2728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e1329e-d154-4dcb-bbf2-91b408dca8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e1329e-d154-4dcb-bbf2-91b408dca8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-327128713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3b65ae-7682-4245-a2c7-1174232f09fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21fe9e10945542e69534b132a557c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:11Z,use_quota=True,user_id='131a6d5db9a84ebb84fe65f6d80a6d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413caeb4-cf30-4af4-b2ac-d0d97de68fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413caeb4-cf30-4af4-b2ac-d0d97de68fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2948c98b-071c-41d2-8738-65aeb9149011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2948c98b-071c-41d2-8738-65aeb9149011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f3b65ae-7682-4245-a2c7-1174232f09fa', 'volume_name': 'volume-2f3b65ae-7682-4245-a2c7-1174232f09fa', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e07a3-67a1-4551-aeb8-42df0d5e2cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e07a3-67a1-4551-aeb8-42df0d5e2cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c0af9f-489d-43e0-916b-9fd2efbb3ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:11 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Volume 2f3b65ae-7682-4245-a2c7-1174232f09fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f3b65ae-7682-4245-a2c7-1174232f09fa', 'volume_size': 1} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-327128713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3b65ae-7682-4245-a2c7-1174232f09fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21fe9e10945542e69534b132a557c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:11Z,use_quota=True,user_id='131a6d5db9a84ebb84fe65f6d80a6d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Creating volume 2f3b65ae-7682-4245-a2c7-1174232f09fa {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:10:11 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:10:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:11 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa 1073741824 Jul 09 15:10:11 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:12 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa 1073741824" returned: 0 in 1.036s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:12 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa Jul 09 15:10:12 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:13 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa" returned: 0 in 0.787s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:10:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c0af9f-489d-43e0-916b-9fd2efbb3ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3b65ae-7682-4245-a2c7-1174232f09fa', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd0ac6f-da87-4eae-a411-919a43efab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:13 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Volume volume-2f3b65ae-7682-4245-a2c7-1174232f09fa (2f3b65ae-7682-4245-a2c7-1174232f09fa): created successfully Jul 09 15:10:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd0ac6f-da87-4eae-a411-919a43efab06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Flow 'volume_create_manager' (ab1fd453-8bf7-4d79-a5ff-566750ea2728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:13 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-be0a8fce-7fa5-435d-be4b-c2285444093f tempest-VolumesListAdminTestJSON-1514933726 None] Created volume successfully. Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Flow 'volume_create_manager' (5ae61db9-f1a7-4570-8d2e-ae6ef19e9d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6385f07-73de-4cc8-bf64-764dd0fd65b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6385f07-73de-4cc8-bf64-764dd0fd65b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-406405091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f86789-7df5-45f8-8071-0f5ea0a2aaf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21fe9e10945542e69534b132a557c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:15Z,use_quota=True,user_id='131a6d5db9a84ebb84fe65f6d80a6d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c5437d-7201-4b43-91d1-3a980fd2dbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c5437d-7201-4b43-91d1-3a980fd2dbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcce2ca6-a6cb-4115-8ad8-845889a829d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcce2ca6-a6cb-4115-8ad8-845889a829d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f86789-7df5-45f8-8071-0f5ea0a2aaf0', 'volume_name': 'volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a602d0c3-a7d8-4bd4-a5c1-30fb032127f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a602d0c3-a7d8-4bd4-a5c1-30fb032127f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1181009-4384-44f2-b032-0a1fc8d5f6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:15 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Volume 26f86789-7df5-45f8-8071-0f5ea0a2aaf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0', 'volume_size': 1} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-406405091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f86789-7df5-45f8-8071-0f5ea0a2aaf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21fe9e10945542e69534b132a557c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:15Z,use_quota=True,user_id='131a6d5db9a84ebb84fe65f6d80a6d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Creating volume 26f86789-7df5-45f8-8071-0f5ea0a2aaf0 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:10:15 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:10:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:15 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0 1073741824 Jul 09 15:10:15 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:16 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0 1073741824" returned: 0 in 1.109s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:16 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0 Jul 09 15:10:16 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:17 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0" returned: 0 in 0.785s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:10:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:17 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=63,cinder:SELECT=42,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:10:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1181009-4384-44f2-b032-0a1fc8d5f6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c04a84-7e8b-4d3b-8541-81cc94ea55fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:17 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Volume volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0 (26f86789-7df5-45f8-8071-0f5ea0a2aaf0): created successfully Jul 09 15:10:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c04a84-7e8b-4d3b-8541-81cc94ea55fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Flow 'volume_create_manager' (5ae61db9-f1a7-4570-8d2e-ae6ef19e9d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:17 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-cf79bb31-7b6f-45ac-8d56-0b69df0f5d20 tempest-VolumesListAdminTestJSON-1514933726 None] Created volume successfully. Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Flow 'volume_create_manager' (e5a3f9a2-a622-4dae-9468-60df258941f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e225d20e-f276-496b-bceb-769079d012e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e225d20e-f276-496b-bceb-769079d012e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-939292305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d5b11c-7328-4916-b52f-97b0a097f666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21fe9e10945542e69534b132a557c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:19Z,use_quota=True,user_id='131a6d5db9a84ebb84fe65f6d80a6d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df974309-c2a9-4ebe-a036-7aeb18bb2383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df974309-c2a9-4ebe-a036-7aeb18bb2383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5943496b-21d8-45d2-a0be-8bdecb815b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5943496b-21d8-45d2-a0be-8bdecb815b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d5b11c-7328-4916-b52f-97b0a097f666', 'volume_name': 'volume-47d5b11c-7328-4916-b52f-97b0a097f666', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f807747b-25d9-4e5e-b0e8-357fbf35a078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f807747b-25d9-4e5e-b0e8-357fbf35a078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8182088d-299d-43a7-9fbd-bc7aef7e9e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:19 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Volume 47d5b11c-7328-4916-b52f-97b0a097f666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d5b11c-7328-4916-b52f-97b0a097f666', 'volume_size': 1} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-939292305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d5b11c-7328-4916-b52f-97b0a097f666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21fe9e10945542e69534b132a557c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:19Z,use_quota=True,user_id='131a6d5db9a84ebb84fe65f6d80a6d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Creating volume 47d5b11c-7328-4916-b52f-97b0a097f666 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:10:19 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:10:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:19 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666 1073741824 Jul 09 15:10:19 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Flow 'volume_create_manager' (832aaa3c-0503-411a-baa7-16e53816c620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442c597b-4516-446b-973f-4a544059ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442c597b-4516-446b-973f-4a544059ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2115221711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a3b4fd-a429-4526-a7ec-2aca9386505e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3bebce94ecb42dcb461c139d246a26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:20Z,use_quota=True,user_id='7141ae7fcc664838bfb80cbb52f15ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ad163c-2d6f-4f2e-b335-6a659e8da174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ad163c-2d6f-4f2e-b335-6a659e8da174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ef3970-07e2-44c3-838e-4b47eb3eeeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ef3970-07e2-44c3-838e-4b47eb3eeeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a3b4fd-a429-4526-a7ec-2aca9386505e', 'volume_name': 'volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777b2733-e373-4a81-a7a7-b4e7e5a33187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777b2733-e373-4a81-a7a7-b4e7e5a33187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce820be-e57b-4885-a767-d31e28386e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:20 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Volume e7a3b4fd-a429-4526-a7ec-2aca9386505e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e', 'volume_size': 1} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:20 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666 1073741824" returned: 0 in 1.115s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:20 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666 Jul 09 15:10:20 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:21 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666" returned: 0 in 0.758s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2115221711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a3b4fd-a429-4526-a7ec-2aca9386505e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3bebce94ecb42dcb461c139d246a26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:20Z,use_quota=True,user_id='7141ae7fcc664838bfb80cbb52f15ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Creating volume e7a3b4fd-a429-4526-a7ec-2aca9386505e {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:10:21 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:21 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e 1073741824 Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8182088d-299d-43a7-9fbd-bc7aef7e9e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d5b11c-7328-4916-b52f-97b0a097f666', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:21 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b069125-2380-41f4-a0ba-c08e27926448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Volume volume-47d5b11c-7328-4916-b52f-97b0a097f666 (47d5b11c-7328-4916-b52f-97b0a097f666): created successfully Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b069125-2380-41f4-a0ba-c08e27926448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Flow 'volume_create_manager' (e5a3f9a2-a622-4dae-9468-60df258941f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:21 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f959879f-96ee-4951-bf27-3cd513bdf9d6 tempest-VolumesListAdminTestJSON-1514933726 None] Created volume successfully. Jul 09 15:10:22 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e 1073741824" returned: 0 in 0.886s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:22 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e Jul 09 15:10:22 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:23 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e" returned: 0 in 0.770s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce820be-e57b-4885-a767-d31e28386e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ec4b45-2d79-45aa-bfe1-7ff9721120e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Volume volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e (e7a3b4fd-a429-4526-a7ec-2aca9386505e): created successfully Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ec4b45-2d79-45aa-bfe1-7ff9721120e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Flow 'volume_create_manager' (832aaa3c-0503-411a-baa7-16e53816c620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:23 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-f39ace76-a57b-4e5e-a74f-cea43075e03d req-da8b9dbf-ea9e-44a4-afc8-b277154f77c2 tempest-VolumesSnapshotsTestJSON-379484799 None] Created volume successfully. Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Flow 'volume_create_manager' (ea78ea05-f086-40ca-8c2a-251c5e8b31a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5532ad-400d-42d0-9d3d-1763a1fa8a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5532ad-400d-42d0-9d3d-1763a1fa8a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7e74a4-f6ff-4191-8f9f-c071fcb01b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='969806b3e76340dea06bbe6cb867f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:23Z,use_quota=True,user_id='8fc1fb3b0fdf43afb61f7d5e325355d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33679cfa-10d7-4b98-ac4b-3c36df0b66ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33679cfa-10d7-4b98-ac4b-3c36df0b66ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834fabb5-77d3-4fdf-bf2a-592bd6499086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834fabb5-77d3-4fdf-bf2a-592bd6499086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7e74a4-f6ff-4191-8f9f-c071fcb01b76', 'volume_name': 'volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3510d89-381e-4f2e-a854-7f473f873410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3510d89-381e-4f2e-a854-7f473f873410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0e77a7-03d6-49cb-b8ab-ac88d89732d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Volume de7e74a4-f6ff-4191-8f9f-c071fcb01b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76', 'volume_size': 1} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7e74a4-f6ff-4191-8f9f-c071fcb01b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='969806b3e76340dea06bbe6cb867f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:23Z,use_quota=True,user_id='8fc1fb3b0fdf43afb61f7d5e325355d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Creating volume de7e74a4-f6ff-4191-8f9f-c071fcb01b76 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:10:23 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:23 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76 1073741824 Jul 09 15:10:23 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:24 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76 1073741824" returned: 0 in 1.078s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:24 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76 Jul 09 15:10:24 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:25 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76" returned: 0 in 0.679s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.623s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0e77a7-03d6-49cb-b8ab-ac88d89732d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20c2b51-b4b8-4e52-bb48-060ec03bddd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:25 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Volume volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76 (de7e74a4-f6ff-4191-8f9f-c071fcb01b76): created successfully Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20c2b51-b4b8-4e52-bb48-060ec03bddd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Flow 'volume_create_manager' (ea78ea05-f086-40ca-8c2a-251c5e8b31a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Creating offline snapshot 9f6bd354-5809-48f1-9436-f0447fd2d0ae of volume e7a3b4fd-a429-4526-a7ec-2aca9386505e {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:10:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-927be8d7-cfe3-4c79-8294-6f7edca8ab6c tempest-VolumesListAdminTestJSON-1902031171 None] Created volume successfully. Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[17343157-5490-440c-b278-fd3e0293b8d4]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:25 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e Jul 09 15:10:25 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:26 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e" returned: 0 in 0.830s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:26 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae 1G Jul 09 15:10:26 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-26409c13-8fed-44a7-84a4-415be4b0ad9b req-144fa64e-21d4-442c-8a2c-30fd7a69f1c2 tempest-AttachVolumeNegativeTest-2087590681 None] Terminate volume connection completed successfully. Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-26409c13-8fed-44a7-84a4-415be4b0ad9b req-144fa64e-21d4-442c-8a2c-30fd7a69f1c2 tempest-AttachVolumeNegativeTest-2087590681 None] Deleting attachment d5ee8239-8871-4239-94ae-4a66a391982d. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Acquiring lock "cinder-de7e74a4-f6ff-4191-8f9f-c071fcb01b76-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Lock "cinder-de7e74a4-f6ff-4191-8f9f-c071fcb01b76-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Acquiring lock "cinder-quobyte-de7e74a4-f6ff-4191-8f9f-c071fcb01b76" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Lock "cinder-quobyte-de7e74a4-f6ff-4191-8f9f-c071fcb01b76" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80febc5-9460-4a00-8044-f123b598a4f8]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "cinder-47d5b11c-7328-4916-b52f-97b0a097f666-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-47d5b11c-7328-4916-b52f-97b0a097f666-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "cinder-quobyte-47d5b11c-7328-4916-b52f-97b0a097f666" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-quobyte-47d5b11c-7328-4916-b52f-97b0a097f666" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:26 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76 Jul 09 15:10:26 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e29898-5545-42ce-8787-d33a7d126dba]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:27 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666 Jul 09 15:10:27 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:27 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae 1G" returned: 0 in 1.022s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:27 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae Jul 09 15:10:27 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:27 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76" returned: 0 in 0.859s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:27 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76 Jul 09 15:10:27 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:27 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666" returned: 0 in 0.856s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:27 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666 Jul 09 15:10:27 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:28 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae" returned: 0 in 0.735s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:28 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae is being set with open permissions: ugo+rw Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:28 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae Jul 09 15:10:28 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:28 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-de7e74a4-f6ff-4191-8f9f-c071fcb01b76" returned: 0 in 0.882s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Lock "cinder-quobyte-de7e74a4-f6ff-4191-8f9f-c071fcb01b76" released by "delete_volume" :: held 1.799s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Created reservations ['7b18cbee-75d3-456e-a7c2-1afce294b0fd', '778bae97-e395-4eb5-b9ec-239207954c7f', 'd7137eca-3c5b-449e-9312-7be7f9c877a8', '15bbbfc0-53a2-4707-9663-b42cf6be18d9'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:28 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-47d5b11c-7328-4916-b52f-97b0a097f666" returned: 0 in 0.887s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-quobyte-47d5b11c-7328-4916-b52f-97b0a097f666" released by "delete_volume" :: held 1.805s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:28 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:10:28 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Created reservations ['faf81ab8-2562-4417-8501-fce4ab4af08b', '71d0cdfa-942a-4b8d-9de4-c5d98c4bd1cf', '1e515cc3-262d-4f14-ae54-566408d77eb2', '6db4541d-a3f2-4476-be74-0555c2cdb924'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:29 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:10:29 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:29 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae" returned: 0 in 1.010s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:29 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.info Jul 09 15:10:29 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "cinder-26f86789-7df5-45f8-8071-0f5ea0a2aaf0-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-26f86789-7df5-45f8-8071-0f5ea0a2aaf0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "cinder-quobyte-26f86789-7df5-45f8-8071-0f5ea0a2aaf0" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-quobyte-26f86789-7df5-45f8-8071-0f5ea0a2aaf0" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4791a720-0893-4b72-9f77-6514616ae53e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:29 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0 Jul 09 15:10:29 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:30 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.387s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:30 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:30 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Deleted volume successfully. Jul 09 15:10:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5901bfe0-a139-431e-92e7-9060047ab90c tempest-VolumesListAdminTestJSON-1902031171 None] Lock "cinder-de7e74a4-f6ff-4191-8f9f-c071fcb01b76-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:30 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.288s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:30 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:30 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Deleted volume successfully. Jul 09 15:10:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9e57f92-e1d1-44db-a2c7-3e5f8a070f5f tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-47d5b11c-7328-4916-b52f-97b0a097f666-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:30 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.info" returned: 0 in 1.214s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:30 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.info is being set with open permissions: ugo+rw Jul 09 15:10:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:30 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.info Jul 09 15:10:30 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:31 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0" returned: 0 in 1.553s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:31 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0 Jul 09 15:10:31 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:31 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.info" returned: 0 in 1.199s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.220s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:31 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-0141055f-d50d-4397-a116-27d732091b52 req-0eaef29e-e205-4075-848d-c9f0ab0cd6fb tempest-VolumesSnapshotsTestJSON-379484799 None] Create snapshot completed successfully Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Acquiring lock "cinder-9f6bd354-5809-48f1-9436-f0447fd2d0ae-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "cinder-9f6bd354-5809-48f1-9436-f0447fd2d0ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Acquiring lock "cinder-quobyte-e7a3b4fd-a429-4526-a7ec-2aca9386505e" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "cinder-quobyte-e7a3b4fd-a429-4526-a7ec-2aca9386505e" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Acquiring lock "cinder-quobyte-9f6bd354-5809-48f1-9436-f0447fd2d0ae" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "cinder-quobyte-9f6bd354-5809-48f1-9436-f0447fd2d0ae" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Deleting offline snapshot 9f6bd354-5809-48f1-9436-f0447fd2d0ae of volume e7a3b4fd-a429-4526-a7ec-2aca9386505e {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] snapshot_file for this snap is: volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ad3a97-2a4b-4495-aab9-772be79dbdb9]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:32 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-26f86789-7df5-45f8-8071-0f5ea0a2aaf0" returned: 0 in 0.965s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-quobyte-26f86789-7df5-45f8-8071-0f5ea0a2aaf0" released by "delete_volume" :: held 2.613s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:32 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae Jul 09 15:10:32 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:32 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Created reservations ['e441a860-c47f-44f5-869d-a549b1f28cc5', 'adaf676c-3f15-4a22-a1da-fca7cdb04e2a', 'e1bf597b-f008-4e10-8bd3-c95f852709aa', '1f8fd58d-48fd-4072-ae55-4cedc02acb1d'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:32 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:10:32 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "cinder-2f3b65ae-7682-4245-a2c7-1174232f09fa-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-2f3b65ae-7682-4245-a2c7-1174232f09fa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:33 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "cinder-quobyte-2f3b65ae-7682-4245-a2c7-1174232f09fa" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae" returned: 0 in 1.200s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae433fd-8b5b-4490-bbf7-73c9ad2dbfd2]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-quobyte-2f3b65ae-7682-4245-a2c7-1174232f09fa" acquired by "delete_volume" :: waited 0.068s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2294bc5-b3dd-413b-8ab2-4ffdfc0cf580]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:33 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.967s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:33 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Deleted volume successfully. Jul 09 15:10:33 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e Jul 09 15:10:33 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0f3c8f94-c155-4fa8-bd1b-52867f6b07ec tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-26f86789-7df5-45f8-8071-0f5ea0a2aaf0-delete_volume" released by "delete_volume" :: held 3.976s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:33 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa Jul 09 15:10:33 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:34 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e" returned: 0 in 0.838s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:34 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae Jul 09 15:10:34 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:34 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa" returned: 0 in 0.913s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:34 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa Jul 09 15:10:34 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:34 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae" returned: 0 in 0.801s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:34 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae Jul 09 15:10:34 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:34 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2f3b65ae-7682-4245-a2c7-1174232f09fa" returned: 0 in 0.722s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-quobyte-2f3b65ae-7682-4245-a2c7-1174232f09fa" released by "delete_volume" :: held 1.680s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:34 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Created reservations ['7a4a79aa-8331-4963-80a1-f260599a45c3', '16834dac-ec2d-4869-853d-3a74653f0075', '6fec54b1-4bc3-4924-a750-10145c56756f', '876ba907-c823-44a9-bf78-e16672519020'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:35 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:10:35 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:35 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e.9f6bd354-5809-48f1-9436-f0447fd2d0ae" returned: 0 in 0.706s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "cinder-quobyte-9f6bd354-5809-48f1-9436-f0447fd2d0ae" released by "_delete_snapshot" :: held 3.699s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "cinder-quobyte-e7a3b4fd-a429-4526-a7ec-2aca9386505e" released by "delete_snapshot" :: held 3.737s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG cinder.quota [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Created reservations ['78a2971d-2492-4f2e-b99b-0ba715457f13', '66925645-b1b5-437b-97dd-136452d5aaf9', '6dae91a8-c666-4d37-a8d7-048f843c54e9', '6fc690c9-973b-45ad-a3b2-31d0d43432ff'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:35 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.698s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Deleted volume successfully. Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb2e21d9-af22-4e2e-9a39-e5f8d9e3b621 tempest-VolumesListAdminTestJSON-1514933726 None] Lock "cinder-2f3b65ae-7682-4245-a2c7-1174232f09fa-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Delete snapshot completed successfully. Jul 09 15:10:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-2f4f61a8-0d4e-47d8-9697-fdd455557ad8 req-5dd47c4f-c20b-409e-a61b-956eb08f09aa tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "cinder-9f6bd354-5809-48f1-9436-f0447fd2d0ae-delete_snapshot" released by "delete_snapshot" :: held 3.988s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Acquiring lock "cinder-e7a3b4fd-a429-4526-a7ec-2aca9386505e-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "cinder-e7a3b4fd-a429-4526-a7ec-2aca9386505e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Acquiring lock "cinder-quobyte-e7a3b4fd-a429-4526-a7ec-2aca9386505e" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "cinder-quobyte-e7a3b4fd-a429-4526-a7ec-2aca9386505e" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:36 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1ff64b-b027-4ad4-a9ef-d4eb21139ef1]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:36 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e Jul 09 15:10:36 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:37 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e" returned: 0 in 1.327s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:37 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e Jul 09 15:10:37 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:38 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7a3b4fd-a429-4526-a7ec-2aca9386505e" returned: 0 in 0.937s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "cinder-quobyte-e7a3b4fd-a429-4526-a7ec-2aca9386505e" released by "delete_volume" :: held 2.378s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:38 devstack cinder-volume[87042]: DEBUG cinder.quota [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Created reservations ['95c2406a-3ccb-47b0-a7b3-fe42b25f412e', '4c47ad69-e3c3-4cc9-b6d9-df1df6cc0cee', 'c312ef5e-547f-482b-9388-d4003b38c5e7', 'f4ca9db2-8578-4fc7-af08-f657626613f5'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:39 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:10:39 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:39 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.984s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:39 devstack cinder-volume[87042]: DEBUG cinder.manager [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:39 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Deleted volume successfully. Jul 09 15:10:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8e920e79-69dd-4e4b-92b3-48615f950948 req-4644598c-ff4a-4552-a80c-9b51844da77a tempest-VolumesSnapshotsTestJSON-379484799 None] Lock "cinder-e7a3b4fd-a429-4526-a7ec-2aca9386505e-delete_volume" released by "delete_volume" :: held 3.722s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Flow 'volume_create_manager' (cef9fe5e-b8eb-41c6-9ac2-daebe2e3216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c8b7c6-3792-4863-ae15-69f1a301ab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c8b7c6-3792-4863-ae15-69f1a301ab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-645494776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea373313-0d3a-4713-a7ac-b6b102dca593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55ed63cd76f4ac3be0fefb0cdb805f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:43Z,use_quota=True,user_id='5290c811062d41b4a30a43df52e666f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c857c202-9109-49bc-b7dc-92708c860eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c857c202-9109-49bc-b7dc-92708c860eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3043408a-d975-4148-8f6a-44da11593a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3043408a-d975-4148-8f6a-44da11593a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea373313-0d3a-4713-a7ac-b6b102dca593', 'volume_name': 'volume-ea373313-0d3a-4713-a7ac-b6b102dca593', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea75b55-4d3c-4219-8914-fa2b39f0816f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea75b55-4d3c-4219-8914-fa2b39f0816f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43129187-54f3-4c78-a4c0-cb5b8278828d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:42 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Volume ea373313-0d3a-4713-a7ac-b6b102dca593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea373313-0d3a-4713-a7ac-b6b102dca593', 'volume_size': 1} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-645494776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea373313-0d3a-4713-a7ac-b6b102dca593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55ed63cd76f4ac3be0fefb0cdb805f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:43Z,use_quota=True,user_id='5290c811062d41b4a30a43df52e666f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Creating volume ea373313-0d3a-4713-a7ac-b6b102dca593 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:10:42 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:10:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:42 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593 1073741824 Jul 09 15:10:42 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:44 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593 1073741824" returned: 0 in 1.241s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:44 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593 Jul 09 15:10:44 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:45 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593" returned: 0 in 0.988s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] <== create_volume: return (2283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:10:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43129187-54f3-4c78-a4c0-cb5b8278828d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea373313-0d3a-4713-a7ac-b6b102dca593', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe0ffd0-40ad-49ef-93bf-cdf3f2d17d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:45 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Volume volume-ea373313-0d3a-4713-a7ac-b6b102dca593 (ea373313-0d3a-4713-a7ac-b6b102dca593): created successfully Jul 09 15:10:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe0ffd0-40ad-49ef-93bf-cdf3f2d17d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Flow 'volume_create_manager' (cef9fe5e-b8eb-41c6-9ac2-daebe2e3216d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a1b44687-cb2b-4270-aa5f-a92128be4db4 tempest-VolumesMetadataTest-447221616 None] Created volume successfully. Jul 09 15:10:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Acquiring lock "cinder-ea373313-0d3a-4713-a7ac-b6b102dca593-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Lock "cinder-ea373313-0d3a-4713-a7ac-b6b102dca593-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Acquiring lock "cinder-quobyte-ea373313-0d3a-4713-a7ac-b6b102dca593" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Lock "cinder-quobyte-ea373313-0d3a-4713-a7ac-b6b102dca593" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[45da899c-bdc7-4edd-a42e-ccae2b8c96d5]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:46 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593 Jul 09 15:10:46 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-07a56fd3-1798-4514-af9e-ef1becda727f tempest-BackendsCapabilitiesAdminTestsJSON-1204582379 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87042) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 15:10:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8e2dc9d-9a62-4cfd-b486-7c8b993d1ec6 tempest-BackendsCapabilitiesAdminTestsJSON-1204582379 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87042) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 15:10:47 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593" returned: 0 in 0.824s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:47 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593 Jul 09 15:10:47 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:48 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ea373313-0d3a-4713-a7ac-b6b102dca593" returned: 0 in 0.678s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Lock "cinder-quobyte-ea373313-0d3a-4713-a7ac-b6b102dca593" released by "delete_volume" :: held 1.543s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:48 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Created reservations ['495176fa-09c3-496f-a042-1c69324b0d26', '6fb7e020-81f8-47c8-ae69-af215360f12b', 'ce725b31-3379-43f9-a063-ea1ff65abb15', 'adf6cc6c-fc61-4a30-976b-6f999a685012'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:48 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:10:48 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:49 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.002s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:49 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:49 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Deleted volume successfully. Jul 09 15:10:49 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=105,cinder:SELECT=73,cinder:DELETE=11,cinder:INSERT=28 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:10:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7a641053-5591-4445-b87d-cff7a351c08f tempest-VolumesMetadataTest-447221616 None] Lock "cinder-ea373313-0d3a-4713-a7ac-b6b102dca593-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Flow 'volume_create_manager' (e937ee74-ef70-4438-a24d-710d7cb443b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e105d7-b713-4f57-8b05-8221590ffebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e105d7-b713-4f57-8b05-8221590ffebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1949499736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe66861d-e64c-4b63-992d-59a567e1221e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f55d2401e7421ab8f85e30754bf026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:54Z,use_quota=True,user_id='bac3574376ee426f95b0e21cc79a2fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001326d3-9b2a-463c-9e8a-b537874a35a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001326d3-9b2a-463c-9e8a-b537874a35a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6a285a-71ed-4527-bc8d-6c082263f741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6a285a-71ed-4527-bc8d-6c082263f741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe66861d-e64c-4b63-992d-59a567e1221e', 'volume_name': 'volume-fe66861d-e64c-4b63-992d-59a567e1221e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24105274-a6f4-4604-897d-d5161d807e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24105274-a6f4-4604-897d-d5161d807e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21f93f7-efa7-49be-8ac9-849441a0a2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:53 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Volume fe66861d-e64c-4b63-992d-59a567e1221e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe66861d-e64c-4b63-992d-59a567e1221e', 'volume_size': 1} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1949499736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe66861d-e64c-4b63-992d-59a567e1221e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f55d2401e7421ab8f85e30754bf026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:54Z,use_quota=True,user_id='bac3574376ee426f95b0e21cc79a2fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Creating volume fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:10:53 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:10:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:53 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e 1073741824 Jul 09 15:10:53 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:54 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e 1073741824" returned: 0 in 0.971s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:55 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e Jul 09 15:10:55 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6b6c2623-2bfe-408b-b0a0-951a9e761f47 tempest-GroupSnapshotsTest-1555359721 None] Group tempest-GroupSnapshotsTest-Group-528368748: creating Jul 09 15:10:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6b6c2623-2bfe-408b-b0a0-951a9e761f47 tempest-GroupSnapshotsTest-1555359721 None] Group tempest-GroupSnapshotsTest-Group-528368748: created successfully Jul 09 15:10:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6b6c2623-2bfe-408b-b0a0-951a9e761f47 tempest-GroupSnapshotsTest-1555359721 None] Create group completed successfully. Jul 09 15:10:55 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e" returned: 0 in 0.862s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:10:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21f93f7-efa7-49be-8ac9-849441a0a2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe66861d-e64c-4b63-992d-59a567e1221e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6a6707-d563-49dc-8231-13a959193095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Volume volume-fe66861d-e64c-4b63-992d-59a567e1221e (fe66861d-e64c-4b63-992d-59a567e1221e): created successfully Jul 09 15:10:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6a6707-d563-49dc-8231-13a959193095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Flow 'volume_create_manager' (e937ee74-ef70-4438-a24d-710d7cb443b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2f2bbb07-1fb3-44dd-ab04-9de6c7d300fb tempest-VolumesCloneTest-1784315822 None] Created volume successfully. Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Flow 'volume_create_manager' (f49cbcea-1982-4d12-978a-231529c0f5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d6106b-667b-42c2-927e-6dbd848166b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d6106b-667b-42c2-927e-6dbd848166b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-354838337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5df36999-5c0e-43a9-80c8-0c12ce6a946b,host='devstack@QuobyteHD#QuobyteHD',id=f7f0248c-5515-411d-b4ce-2e97fe224232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d649a8e13847f9978bf6302f6e0931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:57Z,use_quota=True,user_id='c4274bcd6e9b4b859cfd4bdd92d2774d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dde5b62-8ede-4592-ad27-127d88df0993),volume_type_id=2dde5b62-8ede-4592-ad27-127d88df0993)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1daa2c61-d19f-4ab3-b84c-1dc8fd26e70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1daa2c61-d19f-4ab3-b84c-1dc8fd26e70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545e886b-a51b-4000-a2a0-f98378cd044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545e886b-a51b-4000-a2a0-f98378cd044d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f0248c-5515-411d-b4ce-2e97fe224232', 'volume_name': 'volume-f7f0248c-5515-411d-b4ce-2e97fe224232', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0879ab13-fe84-4580-a017-465f30a88c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0879ab13-fe84-4580-a017-465f30a88c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c3c316-bb6f-4f9c-b2d2-4be0d4c5d2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:57 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Volume f7f0248c-5515-411d-b4ce-2e97fe224232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f0248c-5515-411d-b4ce-2e97fe224232', 'volume_size': 1} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5df36999-5c0e-43a9-80c8-0c12ce6a946b,created_at=2026-07-09T13:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-354838337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5df36999-5c0e-43a9-80c8-0c12ce6a946b,host='devstack@QuobyteHD#QuobyteHD',id=f7f0248c-5515-411d-b4ce-2e97fe224232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d649a8e13847f9978bf6302f6e0931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:57Z,use_quota=True,user_id='c4274bcd6e9b4b859cfd4bdd92d2774d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dde5b62-8ede-4592-ad27-127d88df0993),volume_type_id=2dde5b62-8ede-4592-ad27-127d88df0993)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Creating volume f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:10:57 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:57 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 1073741824 Jul 09 15:10:57 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Flow 'volume_create_manager' (bf49bdbc-eada-4a93-8c83-72240630ff67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e0f404-d3d7-4858-b89e-f10606e9027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e0f404-d3d7-4858-b89e-f10606e9027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1462963864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dab458-9e80-4eeb-ba71-587474c8227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f55d2401e7421ab8f85e30754bf026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=fe66861d-e64c-4b63-992d-59a567e1221e,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:58Z,use_quota=True,user_id='bac3574376ee426f95b0e21cc79a2fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2183ca-b06e-4c27-a292-6634cfdffa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2183ca-b06e-4c27-a292-6634cfdffa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f49ba72-b0f1-482f-a0ff-ca197a4087cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f49ba72-b0f1-482f-a0ff-ca197a4087cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e8dab458-9e80-4eeb-ba71-587474c8227a', 'volume_name': 'volume-e8dab458-9e80-4eeb-ba71-587474c8227a', 'volume_size': 2, 'source_volid': 'fe66861d-e64c-4b63-992d-59a567e1221e', 'source_volstatus': 'available'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80681258-c645-4568-a6d7-5adfd01caa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80681258-c645-4568-a6d7-5adfd01caa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30eaee2-4256-49b2-a470-76bcfe57d87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:57 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Volume e8dab458-9e80-4eeb-ba71-587474c8227a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e8dab458-9e80-4eeb-ba71-587474c8227a', 'volume_size': 2, 'source_volid': 'fe66861d-e64c-4b63-992d-59a567e1221e', 'source_volstatus': 'available'} Jul 09 15:10:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:58 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 1073741824" returned: 0 in 1.032s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:58 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 Jul 09 15:10:58 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:59 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232" returned: 0 in 0.734s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.162s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:59 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Cloning volume fe66861d-e64c-4b63-992d-59a567e1221e to volume e8dab458-9e80-4eeb-ba71-587474c8227a Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c3c316-bb6f-4f9c-b2d2-4be0d4c5d2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f0248c-5515-411d-b4ce-2e97fe224232', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b23b57-6a4e-4d1e-8ac2-8a8ca3cd2019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:59 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Volume volume-f7f0248c-5515-411d-b4ce-2e97fe224232 (f7f0248c-5515-411d-b4ce-2e97fe224232): created successfully Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b23b57-6a4e-4d1e-8ac2-8a8ca3cd2019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Flow 'volume_create_manager' (f49cbcea-1982-4d12-978a-231529c0f5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Creating offline snapshot d9119d94-8fbe-4890-afd4-4baf5580685d of volume fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:10:59 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-33e8b61c-c844-45e6-85fc-00d37ed8ca69 tempest-GroupSnapshotsTest-1555359721 None] Created volume successfully. Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d02d84d-32f0-4caa-a88d-1fd86371e443]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:59 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e Jul 09 15:10:59 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:00 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] GroupSnapshot ade317ee-fe24-467e-952e-eca1c872b738: creating. Jul 09 15:11:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Group snapshot ade317ee-fe24-467e-952e-eca1c872b738: creating. {{(pid=87042) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 15:11:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:00 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e" returned: 0 in 1.345s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:00 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d 1G Jul 09 15:11:00 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:01 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d 1G" returned: 0 in 1.038s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe66861d-e64c-4b63-992d-59a567e1221e -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:01 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe66861d-e64c-4b63-992d-59a567e1221e -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d Jul 09 15:11:01 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:02 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe66861d-e64c-4b63-992d-59a567e1221e -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d" returned: 0 in 0.829s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:02 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d is being set with open permissions: ugo+rw Jul 09 15:11:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:02 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d Jul 09 15:11:02 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:03 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d" returned: 0 in 0.808s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:03 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.info Jul 09 15:11:03 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:03 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.info" returned: 0 in 0.700s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:03 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.info is being set with open permissions: ugo+rw Jul 09 15:11:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:03 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.info Jul 09 15:11:03 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:04 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.info" returned: 0 in 0.676s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Acquiring lock "cinder-quobyte-e8dab458-9e80-4eeb-ba71-587474c8227a" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Lock "cinder-quobyte-e8dab458-9e80-4eeb-ba71-587474c8227a" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] snapshot: d9119d94-8fbe-4890-afd4-4baf5580685d, volume: e8dab458-9e80-4eeb-ba71-587474c8227a, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[af888dd0-0e42-4f10-a51d-2a0295d79801]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:04 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d Jul 09 15:11:04 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:04 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:11:04 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Flow 'volume_create_manager' (eee2b687-a5a3-46d9-9d8f-5ca2a237eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b133c906-0b85-4ff8-9f9b-e09b845b6961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b133c906-0b85-4ff8-9f9b-e09b845b6961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1300086523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c125241f-b976-4c24-82ac-78823c753fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740f247e667d4d4fa14c443f7e9d9289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:05Z,use_quota=True,user_id='33f3c0dcce7246e9a3cb2ef292179f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e493e329-74f7-4228-8e9a-f22baba4da16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e493e329-74f7-4228-8e9a-f22baba4da16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7821c4ff-4d54-4397-bc96-5d90b12371f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7821c4ff-4d54-4397-bc96-5d90b12371f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c125241f-b976-4c24-82ac-78823c753fd2', 'volume_name': 'volume-c125241f-b976-4c24-82ac-78823c753fd2', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2339bf8-ac86-416b-8cda-d87eebcd4590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2339bf8-ac86-416b-8cda-d87eebcd4590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d601552e-9278-42a5-bf59-ff695716a98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:05 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Volume c125241f-b976-4c24-82ac-78823c753fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c125241f-b976-4c24-82ac-78823c753fd2', 'volume_size': 1} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:05 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.734s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 8 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:11:05 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d" returned: 0 in 0.927s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe66861d-e64c-4b63-992d-59a567e1221e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf2b4ad-cd21-4057-b867-b1e250a859bd]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:05 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e Jul 09 15:11:05 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:06 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e" returned: 0 in 0.808s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:06 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:11:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:06 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a Jul 09 15:11:06 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:11 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a" returned: 0 in 5.177s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:11 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c2299c-a4a8-4b04-ba19-d8a7216108e9]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:11 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e Jul 09 15:11:11 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:12 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e" returned: 0 in 0.922s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:12 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:11:12 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Converted 1024.00 MB image at 197.76 MB/s Jul 09 15:11:12 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a is being set with open permissions: ugo+rw Jul 09 15:11:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:12 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a Jul 09 15:11:12 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:13 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a" returned: 0 in 0.665s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Lock "cinder-quobyte-e8dab458-9e80-4eeb-ba71-587474c8227a" released by "_copy_volume_from_snapshot" :: held 8.596s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Acquiring lock "cinder-quobyte-d9119d94-8fbe-4890-afd4-4baf5580685d" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Lock "cinder-quobyte-d9119d94-8fbe-4890-afd4-4baf5580685d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Deleting offline snapshot d9119d94-8fbe-4890-afd4-4baf5580685d of volume fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:11:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] snapshot_file for this snap is: volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:11:13 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[71812e2e-b577-4313-b6f7-ec87005c6500]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:13 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d Jul 09 15:11:13 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:14 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d" returned: 0 in 0.770s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe66861d-e64c-4b63-992d-59a567e1221e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:11:14 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1491612e-82fd-4e63-a43e-f410aaaffe5b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:14 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e Jul 09 15:11:14 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:14 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e" returned: 0 in 0.756s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:14 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d Jul 09 15:11:14 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:15 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=8,cinder:SELECT=8,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:11:15 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d" returned: 0 in 0.729s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:15 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d Jul 09 15:11:15 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:16 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e.d9119d94-8fbe-4890-afd4-4baf5580685d" returned: 0 in 0.646s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Lock "cinder-quobyte-d9119d94-8fbe-4890-afd4-4baf5580685d" released by "_delete_snapshot" :: held 2.987s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.281s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.172s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30eaee2-4256-49b2-a470-76bcfe57d87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8dab458-9e80-4eeb-ba71-587474c8227a', 'volume_size': 2, 'source_volid': 'fe66861d-e64c-4b63-992d-59a567e1221e', 'source_volstatus': 'available'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff760eb-f417-488a-a36f-ad2ba7157d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Creating offline snapshot 12ed5574-7f18-438f-926a-e85789855fe2 of volume f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:11:16 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Volume volume-e8dab458-9e80-4eeb-ba71-587474c8227a (e8dab458-9e80-4eeb-ba71-587474c8227a): created successfully Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff760eb-f417-488a-a36f-ad2ba7157d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Flow 'volume_create_manager' (bf49bdbc-eada-4a93-8c83-72240630ff67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[93587c64-6bda-41f2-9f61-fa5e85662960]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:16 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d648d5d8-d1e1-444e-b949-43b0f8f3b68b tempest-VolumesCloneTest-1784315822 None] Created volume successfully. Jul 09 15:11:16 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 Jul 09 15:11:16 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:17 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232" returned: 0 in 0.748s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:17 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 1G Jul 09 15:11:17 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Acquiring lock "cinder-e8dab458-9e80-4eeb-ba71-587474c8227a-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Lock "cinder-e8dab458-9e80-4eeb-ba71-587474c8227a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Acquiring lock "cinder-quobyte-e8dab458-9e80-4eeb-ba71-587474c8227a" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Lock "cinder-quobyte-e8dab458-9e80-4eeb-ba71-587474c8227a" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:17 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76ea8f7-df04-43e7-9657-65f097ab85f4]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:17 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a Jul 09 15:11:17 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:17 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 1G" returned: 0 in 0.773s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7f0248c-5515-411d-b4ce-2e97fe224232 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:17 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7f0248c-5515-411d-b4ce-2e97fe224232 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 Jul 09 15:11:17 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:18 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a" returned: 0 in 0.770s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:18 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a Jul 09 15:11:18 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:18 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7f0248c-5515-411d-b4ce-2e97fe224232 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2" returned: 0 in 0.730s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:18 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:11:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:18 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 Jul 09 15:11:18 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:18 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e8dab458-9e80-4eeb-ba71-587474c8227a" returned: 0 in 0.643s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Lock "cinder-quobyte-e8dab458-9e80-4eeb-ba71-587474c8227a" released by "delete_volume" :: held 1.463s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:18 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=87,cinder:SELECT=70,cinder:DELETE=5,cinder:INSERT=13 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:11:18 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Created reservations ['7eefb578-f6b4-42d8-941e-498e415beaa5', '19a95ffe-3d09-4a4f-9877-49ad9acd5224', '7651b751-6709-4803-9041-75ad71c430fc', 'b0e80ef2-09ac-4ab0-8732-6ab7fbfb588e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:19 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:11:19 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:19 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2" returned: 0 in 0.666s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:19 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.info Jul 09 15:11:19 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Acquiring lock "cinder-fe66861d-e64c-4b63-992d-59a567e1221e-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Lock "cinder-fe66861d-e64c-4b63-992d-59a567e1221e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:19 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.684s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:11:19 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Deleted volume successfully. Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Acquiring lock "cinder-quobyte-fe66861d-e64c-4b63-992d-59a567e1221e" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Lock "cinder-quobyte-fe66861d-e64c-4b63-992d-59a567e1221e" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c6e4c44-3ce1-4b90-b55d-ec1bbe54aa30 tempest-VolumesCloneTest-1784315822 None] Lock "cinder-e8dab458-9e80-4eeb-ba71-587474c8227a-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4079b989-77eb-4a93-8f0c-edf9e996fa56]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:19 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e Jul 09 15:11:19 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:20 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.info" returned: 0 in 0.680s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:20 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:20 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.info Jul 09 15:11:20 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:20 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e" returned: 0 in 0.839s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:20 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e Jul 09 15:11:20 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:20 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.info" returned: 0 in 0.691s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.396s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.466s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1300086523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c125241f-b976-4c24-82ac-78823c753fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740f247e667d4d4fa14c443f7e9d9289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:05Z,use_quota=True,user_id='33f3c0dcce7246e9a3cb2ef292179f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Creating volume c125241f-b976-4c24-82ac-78823c753fd2 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:20 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:11:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:20 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 1073741824 Jul 09 15:11:20 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:20 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-00a00acb-1697-4ce8-97e8-00bafc29fbe6 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot ade317ee-fe24-467e-952e-eca1c872b738: created successfully Jul 09 15:11:21 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe66861d-e64c-4b63-992d-59a567e1221e" returned: 0 in 0.786s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Lock "cinder-quobyte-fe66861d-e64c-4b63-992d-59a567e1221e" released by "delete_volume" :: held 1.694s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Created reservations ['7f3141aa-968f-4e23-8370-4aa27f94b283', '42c0b04d-06b6-411e-8cd2-510e5c20c21f', '8ed206cf-6617-48d8-9a5b-0c84d1419862', 'ca1a418d-5b6f-437e-81b0-bbfdfae8f9e5'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:21 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:11:21 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:21 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 1073741824" returned: 0 in 0.963s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:21 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 Jul 09 15:11:21 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:22 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.833s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:11:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Deleted volume successfully. Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f957fd77-b316-4569-b6ab-7f088311c2aa tempest-VolumesCloneTest-1784315822 None] Lock "cinder-fe66861d-e64c-4b63-992d-59a567e1221e-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:22 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2" returned: 0 in 0.914s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.014s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-12ed5574-7f18-438f-926a-e85789855fe2-907baca8-9771-404f-b11c-66d1f991c7b8" by "_create_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d601552e-9278-42a5-bf59-ff695716a98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c125241f-b976-4c24-82ac-78823c753fd2', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc7ea65-3b2d-4bae-8f90-9d2d471a182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-12ed5574-7f18-438f-926a-e85789855fe2-907baca8-9771-404f-b11c-66d1f991c7b8" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Creating volume 907baca8-9771-404f-b11c-66d1f991c7b8 from snapshot 12ed5574-7f18-438f-926a-e85789855fe2 {{(pid=87042) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-907baca8-9771-404f-b11c-66d1f991c7b8" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Volume volume-c125241f-b976-4c24-82ac-78823c753fd2 (c125241f-b976-4c24-82ac-78823c753fd2): created successfully Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc7ea65-3b2d-4bae-8f90-9d2d471a182a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Flow 'volume_create_manager' (eee2b687-a5a3-46d9-9d8f-5ca2a237eaad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-907baca8-9771-404f-b11c-66d1f991c7b8" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] snapshot: 12ed5574-7f18-438f-926a-e85789855fe2, volume: 907baca8-9771-404f-b11c-66d1f991c7b8, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-4d3a8218-93a8-4d3a-998b-f53388b1e5ec tempest-AttachVolumeTestJSON-2101523604 None] Created volume successfully. Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9570eb5-f9c7-40ec-9246-38044236e676]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:23 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 Jul 09 15:11:23 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Flow 'volume_create_manager' (a03f41a2-6350-4b42-b882-85dd588d6b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45442881-4c93-4ed1-9447-1e1096acf7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45442881-4c93-4ed1-9447-1e1096acf7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-794944861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe344b48-9410-43f5-a4fa-63c5ed48d48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162fc8e028e549f5a23d2a0f609f7ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:23Z,use_quota=True,user_id='27fa6a2d907543d2a31f40aa5297b26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2c43d6-7098-499b-9317-8d1375952f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2c43d6-7098-499b-9317-8d1375952f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df68b98-b5dd-4f1e-83b1-366947dfe66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df68b98-b5dd-4f1e-83b1-366947dfe66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe344b48-9410-43f5-a4fa-63c5ed48d48f', 'volume_name': 'volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c532ea7-0d33-4d92-bfa1-7e14419ba67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c532ea7-0d33-4d92-bfa1-7e14419ba67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04a2d49-51ed-4fd0-a48d-c195589bc4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Volume fe344b48-9410-43f5-a4fa-63c5ed48d48f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f', 'volume_size': 1} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:23 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2" returned: 0 in 0.947s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7f0248c-5515-411d-b4ce-2e97fe224232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8db77b4-2f5a-401f-b509-b6222a6a916f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:23 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 Jul 09 15:11:23 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:24 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232" returned: 0 in 0.807s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:24 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:11:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:24 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 Jul 09 15:11:24 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (586932bb-1b55-4bb5-b71e-ced9c2cad29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921c7be7-78c6-49f1-a605-d642085b25a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921c7be7-78c6-49f1-a605-d642085b25a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-230651474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40b1285-5df8-49fb-8c90-3d4e39ba991f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:26Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa47329-37a4-4eba-89bb-4cf6eaa3e1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa47329-37a4-4eba-89bb-4cf6eaa3e1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65898ae5-1118-48c9-81f6-84f3c7ac007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65898ae5-1118-48c9-81f6-84f3c7ac007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f40b1285-5df8-49fb-8c90-3d4e39ba991f', 'volume_name': 'volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98903a34-b52e-4169-86f5-0b3f7b881d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98903a34-b52e-4169-86f5-0b3f7b881d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ab26bd-4dac-4406-a2a3-df8daa6693f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:25 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Volume f40b1285-5df8-49fb-8c90-3d4e39ba991f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f', 'volume_size': 1} Jul 09 15:11:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-dcafa38b-ca68-4ba4-a8ea-e87c4fa9378a req-200df176-e50e-424f-9ab9-6a5a21693f36 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:29 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8" returned: 0 in 5.053s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d7f3b8-781e-4f63-91de-8ee06e27fd27]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:29 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 Jul 09 15:11:29 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:30 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232" returned: 0 in 0.918s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:30 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:11:30 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Converted 1024.00 MB image at 202.62 MB/s Jul 09 15:11:30 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:11:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:30 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 Jul 09 15:11:30 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:31 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8" returned: 0 in 0.638s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-907baca8-9771-404f-b11c-66d1f991c7b8" released by "_copy_volume_from_snapshot" :: held 8.487s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-12ed5574-7f18-438f-926a-e85789855fe2-907baca8-9771-404f-b11c-66d1f991c7b8" released by "_create_volume_from_snapshot" :: held 8.544s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.589s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.951s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-794944861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe344b48-9410-43f5-a4fa-63c5ed48d48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162fc8e028e549f5a23d2a0f609f7ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:23Z,use_quota=True,user_id='27fa6a2d907543d2a31f40aa5297b26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Creating volume fe344b48-9410-43f5-a4fa-63c5ed48d48f {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:31 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:11:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:31 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f 1073741824 Jul 09 15:11:31 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:31 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-11604d2d-d3eb-4d9e-be2e-f45b7c4ca1dd tempest-GroupSnapshotsTest-1555359721 None] Create group from source-snapshot-ade317ee-fe24-467e-952e-eca1c872b738 completed successfully. Jul 09 15:11:32 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f 1073741824" returned: 0 in 0.875s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-907baca8-9771-404f-b11c-66d1f991c7b8" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-907baca8-9771-404f-b11c-66d1f991c7b8" acquired by "delete_volume" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:32 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f Jul 09 15:11:32 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[13089170-a3f5-4d16-bb97-13b4e37a8d6c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:32 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 Jul 09 15:11:32 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:32 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f" returned: 0 in 0.697s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.050s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-230651474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40b1285-5df8-49fb-8c90-3d4e39ba991f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:26Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Creating volume f40b1285-5df8-49fb-8c90-3d4e39ba991f {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:32 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:32 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f 1073741824 Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04a2d49-51ed-4fd0-a48d-c195589bc4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:32 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95258bfe-0f45-4602-9a13-fcdc897a9385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:32 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Volume volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f (fe344b48-9410-43f5-a4fa-63c5ed48d48f): created successfully Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95258bfe-0f45-4602-9a13-fcdc897a9385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Flow 'volume_create_manager' (a03f41a2-6350-4b42-b882-85dd588d6b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b6dbab10-ebf2-4137-a005-a7cd975d94ba tempest-AttachVolumeNegativeTest-2087590681 None] Created volume successfully. Jul 09 15:11:33 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8" returned: 0 in 0.794s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:33 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8 Jul 09 15:11:33 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:33 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-907baca8-9771-404f-b11c-66d1f991c7b8" returned: 0 in 0.701s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:33 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f 1073741824" returned: 0 in 0.853s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-907baca8-9771-404f-b11c-66d1f991c7b8" released by "delete_volume" :: held 1.548s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:33 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f Jul 09 15:11:33 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:33 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['560aa02c-8f29-4cb6-863f-5d8bed15dfb4'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:11:33 devstack cinder-volume[87042]: WARNING cinder.quota [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1208071466 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1208071466, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:11:33 devstack cinder-volume[87042]: WARNING cinder.quota [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1208071466 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1208071466, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:11:33 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['1da4ab42-f5e8-42eb-b99d-95c51fbd498c', 'c33b1a2e-986a-4ae3-9cb6-48bd72e25c84', '5b0c3db2-f577-4f79-9ca0-6381f19f598c', '9d62bf53-7963-4365-bd86-5766ecf64fbb'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:34 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:11:34 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:34 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f" returned: 0 in 0.698s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-dcafa38b-ca68-4ba4-a8ea-e87c4fa9378a req-200df176-e50e-424f-9ab9-6a5a21693f36 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.104s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ab26bd-4dac-4406-a2a3-df8daa6693f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d05c903-fe77-4ce2-9fb6-8d4879b9fa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c2a4a-d7fa-4330-bb40-0afcb7e09b1c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-dcafa38b-ca68-4ba4-a8ea-e87c4fa9378a req-200df176-e50e-424f-9ab9-6a5a21693f36 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:34 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Volume volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f (f40b1285-5df8-49fb-8c90-3d4e39ba991f): created successfully Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d05c903-fe77-4ce2-9fb6-8d4879b9fa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (586932bb-1b55-4bb5-b71e-ced9c2cad29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot ade317ee-fe24-467e-952e-eca1c872b738: deleting Jul 09 15:11:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6cdc1943-fe2c-4521-9b2a-0deb569c1793 tempest-VolumesGetTest-560439043 None] Created volume successfully. Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot ade317ee-fe24-467e-952e-eca1c872b738: deleting {{(pid=87042) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-f7f0248c-5515-411d-b4ce-2e97fe224232" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:34 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.669s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:11:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e27bf24f-1b33-4de6-8847-0831bfa32ed7 tempest-GroupSnapshotsTest-1555359721 None] Delete group completed successfully. Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-f7f0248c-5515-411d-b4ce-2e97fe224232" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-12ed5574-7f18-438f-926a-e85789855fe2" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:34 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 Jul 09 15:11:34 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-12ed5574-7f18-438f-926a-e85789855fe2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Deleting offline snapshot 12ed5574-7f18-438f-926a-e85789855fe2 of volume f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] snapshot_file for this snap is: volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec79880f-82b8-4345-aa14-e27071cd8be9]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:34 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 Jul 09 15:11:34 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:35 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-dcafa38b-ca68-4ba4-a8ea-e87c4fa9378a req-200df176-e50e-424f-9ab9-6a5a21693f36 tempest-AttachVolumeTestJSON-2101523604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2" returned: 0 in 0.836s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-dcafa38b-ca68-4ba4-a8ea-e87c4fa9378a req-200df176-e50e-424f-9ab9-6a5a21693f36 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.868s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-dcafa38b-ca68-4ba4-a8ea-e87c4fa9378a req-200df176-e50e-424f-9ab9-6a5a21693f36 tempest-AttachVolumeTestJSON-2101523604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-c125241f-b976-4c24-82ac-78823c753fd2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbac3410-1f5e-404d-9ad2-952f01819c94', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:11:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-dcafa38b-ca68-4ba4-a8ea-e87c4fa9378a req-200df176-e50e-424f-9ab9-6a5a21693f36 tempest-AttachVolumeTestJSON-2101523604 None] attachment_update completed successfully. Jul 09 15:11:35 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2" returned: 0 in 0.863s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7f0248c-5515-411d-b4ce-2e97fe224232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:11:35 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4e6c5f-140f-4625-a51d-40376c09d433]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:35 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 Jul 09 15:11:35 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (8c8e26bd-32e8-4db7-bde2-a07c79c5dcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da41759-db13-4a91-a94e-4e793b10f997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da41759-db13-4a91-a94e-4e793b10f997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2075859179',display_name='tempest-VolumesGetTest-Volume-561576041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dc7e0f-1631-4a45-99f6-c56feefc5981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:36Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913cad1b-a789-4ef7-ba06-cf6d16938078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913cad1b-a789-4ef7-ba06-cf6d16938078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd619dc3-a89c-4788-a8b3-827e540c020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd619dc3-a89c-4788-a8b3-827e540c020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9dc7e0f-1631-4a45-99f6-c56feefc5981', 'volume_name': 'volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5aec23-c346-44ee-b1c2-36970bf68aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5aec23-c346-44ee-b1c2-36970bf68aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e91330-448e-4e8b-986b-8c410eadd66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:36 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Volume f9dc7e0f-1631-4a45-99f6-c56feefc5981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981', 'volume_size': 1} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2075859179',display_name='tempest-VolumesGetTest-Volume-561576041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dc7e0f-1631-4a45-99f6-c56feefc5981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:36Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Creating volume f9dc7e0f-1631-4a45-99f6-c56feefc5981 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:36 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:36 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981 1073741824 Jul 09 15:11:36 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-e65bb89b-1498-4c6d-bd0c-1c709500c90b req-1a2c29d2-3a50-4a00-b504-d3d62652321d tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:36 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232" returned: 0 in 0.944s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:36 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 Jul 09 15:11:36 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:37 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981 1073741824" returned: 0 in 0.935s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:37 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2" returned: 0 in 0.828s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:37 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981 Jul 09 15:11:37 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:37 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2 Jul 09 15:11:37 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:38 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981" returned: 0 in 0.681s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-e65bb89b-1498-4c6d-bd0c-1c709500c90b req-1a2c29d2-3a50-4a00-b504-d3d62652321d tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.620s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:38 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232.12ed5574-7f18-438f-926a-e85789855fe2" returned: 0 in 0.685s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f719d3-db4d-4f4e-ab30-97772001d7f8]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-e65bb89b-1498-4c6d-bd0c-1c709500c90b req-1a2c29d2-3a50-4a00-b504-d3d62652321d tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e91330-448e-4e8b-986b-8c410eadd66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8329028-9035-4a47-b808-36fe862a2351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-12ed5574-7f18-438f-926a-e85789855fe2" released by "_delete_snapshot" :: held 3.433s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-f7f0248c-5515-411d-b4ce-2e97fe224232" released by "delete_snapshot" :: held 3.465s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:38 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Volume volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981 (f9dc7e0f-1631-4a45-99f6-c56feefc5981): created successfully Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8329028-9035-4a47-b808-36fe862a2351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (8c8e26bd-32e8-4db7-bde2-a07c79c5dcc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:38 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c2ad2840-2c93-45d8-9e3a-01af743cb774 tempest-VolumesGetTest-560439043 None] Created volume successfully. Jul 09 15:11:38 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f Jul 09 15:11:38 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:38 devstack cinder-volume[87042]: WARNING cinder.quota [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1208071466 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1208071466, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['f5034edc-5e3e-409b-8bf6-c12ae5c2fdb4', 'aa4ebb06-e4c9-4f5d-8cb0-3344d9159344', '3c04f71f-4ac2-4b8a-af2e-efb6885851de', '8cdce11f-ec95-4bad-9eca-af30e84a2236'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:11:38 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-30eeadca-d575-444f-8054-dfd33ae55f74 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot ade317ee-fe24-467e-952e-eca1c872b738: deleted successfully Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-f9dc7e0f-1631-4a45-99f6-c56feefc5981-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Lock "cinder-f9dc7e0f-1631-4a45-99f6-c56feefc5981-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-quobyte-f9dc7e0f-1631-4a45-99f6-c56feefc5981" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-f9dc7e0f-1631-4a45-99f6-c56feefc5981" acquired by "delete_volume" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52eb4f4-ca56-46a1-8012-7db188ac4a3e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:38 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981 Jul 09 15:11:38 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:38 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-e65bb89b-1498-4c6d-bd0c-1c709500c90b req-1a2c29d2-3a50-4a00-b504-d3d62652321d tempest-AttachVolumeNegativeTest-2087590681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f" returned: 0 in 0.849s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-e65bb89b-1498-4c6d-bd0c-1c709500c90b req-1a2c29d2-3a50-4a00-b504-d3d62652321d tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.887s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-e65bb89b-1498-4c6d-bd0c-1c709500c90b req-1a2c29d2-3a50-4a00-b504-d3d62652321d tempest-AttachVolumeNegativeTest-2087590681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56039f30-f26e-4f0d-9177-c1b90079a203', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:11:39 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-e65bb89b-1498-4c6d-bd0c-1c709500c90b req-1a2c29d2-3a50-4a00-b504-d3d62652321d tempest-AttachVolumeNegativeTest-2087590681 None] attachment_update completed successfully. Jul 09 15:11:39 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981" returned: 0 in 0.792s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:39 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981 Jul 09 15:11:39 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-f7f0248c-5515-411d-b4ce-2e97fe224232" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-f7f0248c-5515-411d-b4ce-2e97fe224232" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:39 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9945786-e903-4518-a99e-b6a18765d26c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:39 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 Jul 09 15:11:39 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:40 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f9dc7e0f-1631-4a45-99f6-c56feefc5981" returned: 0 in 0.747s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-f9dc7e0f-1631-4a45-99f6-c56feefc5981" released by "delete_volume" :: held 1.607s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Created reservations ['455480bf-7288-4725-bd5a-5c2928cccf78', '88a66413-8eb8-45b0-a6d7-780f766c4d72', 'e884ee01-cfba-4f4e-975d-c983460a0a62', '0a199c44-eb84-45ce-b5e1-a270bc0ab06f'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:40 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:11:40 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:40 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232" returned: 0 in 0.895s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:40 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232 Jul 09 15:11:40 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-f40b1285-5df8-49fb-8c90-3d4e39ba991f-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Lock "cinder-f40b1285-5df8-49fb-8c90-3d4e39ba991f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-quobyte-f40b1285-5df8-49fb-8c90-3d4e39ba991f" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-f40b1285-5df8-49fb-8c90-3d4e39ba991f" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5932baf-79d1-4e2e-a0be-c5b8b418f510]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:41 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.788s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:11:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Deleted volume successfully. Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-71811d94-b059-45ef-802b-d8525c88e571 tempest-VolumesGetTest-560439043 None] Lock "cinder-f9dc7e0f-1631-4a45-99f6-c56feefc5981-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:41 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f Jul 09 15:11:41 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Flow 'volume_create_manager' (d82ecad7-2c55-4e04-a483-73d479570785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e42dd60-d37f-4677-bf3b-dbbcddc0b2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e42dd60-d37f-4677-bf3b-dbbcddc0b2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-350341166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740f247e667d4d4fa14c443f7e9d9289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:41Z,use_quota=True,user_id='33f3c0dcce7246e9a3cb2ef292179f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d4d6e1-907c-4e2f-b9a3-24c0a69dcc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d4d6e1-907c-4e2f-b9a3-24c0a69dcc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d062e5-dd5f-4399-aa0b-d85e47f27497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d062e5-dd5f-4399-aa0b-d85e47f27497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf', 'volume_name': 'volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c7eec0-ea59-46fb-b462-d900ad6fdd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c7eec0-ea59-46fb-b462-d900ad6fdd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8c937d-70fc-4245-b468-6665979f903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:41 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Volume 2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf', 'volume_size': 1} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-350341166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740f247e667d4d4fa14c443f7e9d9289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:41Z,use_quota=True,user_id='33f3c0dcce7246e9a3cb2ef292179f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Creating volume 2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:41 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:41 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf 1073741824 Jul 09 15:11:41 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:41 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7f0248c-5515-411d-b4ce-2e97fe224232" returned: 0 in 0.896s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-f7f0248c-5515-411d-b4ce-2e97fe224232" released by "delete_volume" :: held 1.849s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['c9049d15-caea-4dfc-82cd-e4901d4c48cc'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:11:41 devstack cinder-volume[87042]: WARNING cinder.db.api [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1208071466'] Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['64427046-5333-45b4-9129-fdd753bfbb71', '94852da4-fa4c-4a6c-a432-b54406f78d07', 'ae052457-c036-4bac-946f-eb68d464942f', 'bfdaf8d9-566b-4fba-80ef-1294650db54c'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:41 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:11:41 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:41 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f" returned: 0 in 0.903s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:42 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f Jul 09 15:11:42 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:42 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf 1073741824" returned: 0 in 0.981s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:42 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf Jul 09 15:11:42 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:42 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.796s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:11:42 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2c28de70-02c0-4c21-b4f5-b803af0dda17 tempest-GroupSnapshotsTest-1555359721 None] Delete group completed successfully. Jul 09 15:11:42 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f40b1285-5df8-49fb-8c90-3d4e39ba991f" returned: 0 in 0.811s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:42 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-bd0ac1de-e361-4ccd-9784-db5e5cf5f398 tempest-GroupSnapshotsTest-1555359721 None] Group tempest-GroupSnapshotsTest-Group-1326758601: creating Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-f40b1285-5df8-49fb-8c90-3d4e39ba991f" released by "delete_volume" :: held 1.817s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:42 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-bd0ac1de-e361-4ccd-9784-db5e5cf5f398 tempest-GroupSnapshotsTest-1555359721 None] Group tempest-GroupSnapshotsTest-Group-1326758601: created successfully Jul 09 15:11:42 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-bd0ac1de-e361-4ccd-9784-db5e5cf5f398 tempest-GroupSnapshotsTest-1555359721 None] Create group completed successfully. Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Created reservations ['f438a421-632d-4b73-a570-6399770e9af6', '30c1e2bd-46f6-46b7-ab67-fe3db9b05022', 'fc1f6e1f-49c6-4e33-9368-c3368d2f3aea', '29645c8d-90ad-469a-aaa1-9eca6520604b'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:42 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:11:42 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:43 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf" returned: 0 in 0.769s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8c937d-70fc-4245-b468-6665979f903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc79ef0d-689e-4039-a9e5-6ac595215790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:43 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Volume volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf (2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf): created successfully Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc79ef0d-689e-4039-a9e5-6ac595215790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Flow 'volume_create_manager' (d82ecad7-2c55-4e04-a483-73d479570785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:43 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-554abaf5-3f67-4981-90a5-bae5b5c11a0a tempest-AttachVolumeTestJSON-2101523604 None] Created volume successfully. Jul 09 15:11:43 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.726s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:11:43 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Deleted volume successfully. Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-84041f3f-e76e-458d-a664-1d2ed39bdf62 tempest-VolumesGetTest-560439043 None] Lock "cinder-f40b1285-5df8-49fb-8c90-3d4e39ba991f-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (646e268b-0e3e-4738-82f7-732fb4750ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cc90cd-c6c5-4fa5-bcd6-2800ef91321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cc90cd-c6c5-4fa5-bcd6-2800ef91321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-437265921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48ad41c-662d-4bde-8343-952af01a8f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:44Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f906bad2-d42c-4dda-9909-782267ff469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f906bad2-d42c-4dda-9909-782267ff469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540b7b2d-d137-4017-98be-b4ee2fead023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540b7b2d-d137-4017-98be-b4ee2fead023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a48ad41c-662d-4bde-8343-952af01a8f7c', 'volume_name': 'volume-a48ad41c-662d-4bde-8343-952af01a8f7c', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc82c396-155e-4a22-acff-d3a7dcc7cfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc82c396-155e-4a22-acff-d3a7dcc7cfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd4aa9b-0a3c-44c1-9ee8-87204d007b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:44 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Volume a48ad41c-662d-4bde-8343-952af01a8f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a48ad41c-662d-4bde-8343-952af01a8f7c', 'volume_size': 1} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-437265921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48ad41c-662d-4bde-8343-952af01a8f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:44Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Creating volume a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:44 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:44 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c 1073741824 Jul 09 15:11:44 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Flow 'volume_create_manager' (8ca3fbde-1e8c-4de7-8fc8-b49e9c5fa0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad96bbe-c2f7-4654-bf38-842df7a25caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad96bbe-c2f7-4654-bf38-842df7a25caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1142864636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cd32bb9a-7745-4864-8933-ea72d3f15022,host='devstack@QuobyteHD#QuobyteHD',id=c25234ee-dc7c-467d-bdbf-39e5e9c022b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d649a8e13847f9978bf6302f6e0931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:44Z,use_quota=True,user_id='c4274bcd6e9b4b859cfd4bdd92d2774d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02382a7b-d104-4d64-99bd-51e237e18f5f),volume_type_id=02382a7b-d104-4d64-99bd-51e237e18f5f)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45329fc-e963-4945-b9fa-9b25573bf276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45329fc-e963-4945-b9fa-9b25573bf276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614f3c64-0e05-4df5-a977-1f43cdb20711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614f3c64-0e05-4df5-a977-1f43cdb20711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25234ee-dc7c-467d-bdbf-39e5e9c022b6', 'volume_name': 'volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14237b97-0524-40a0-9029-4b7b6d78e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14237b97-0524-40a0-9029-4b7b6d78e375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6b5d3f-bb11-407d-b74b-3901caa520a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:44 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Volume c25234ee-dc7c-467d-bdbf-39e5e9c022b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6', 'volume_size': 1} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:44 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c 1073741824" returned: 0 in 0.889s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:44 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c Jul 09 15:11:44 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-d0bc7545-0c87-4e4f-9c0a-802db6ae4a68 req-c4788e44-8d96-4950-9d2f-b2b03719a347 tempest-AttachVolumeNegativeTest-2087590681 None] Terminate volume connection completed successfully. Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-d0bc7545-0c87-4e4f-9c0a-802db6ae4a68 req-c4788e44-8d96-4950-9d2f-b2b03719a347 tempest-AttachVolumeNegativeTest-2087590681 None] Deleting attachment 56039f30-f26e-4f0d-9177-c1b90079a203. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:11:45 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c" returned: 0 in 0.696s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.075s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cd32bb9a-7745-4864-8933-ea72d3f15022,created_at=2026-07-09T13:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1142864636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cd32bb9a-7745-4864-8933-ea72d3f15022,host='devstack@QuobyteHD#QuobyteHD',id=c25234ee-dc7c-467d-bdbf-39e5e9c022b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d649a8e13847f9978bf6302f6e0931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:44Z,use_quota=True,user_id='c4274bcd6e9b4b859cfd4bdd92d2774d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02382a7b-d104-4d64-99bd-51e237e18f5f),volume_type_id=02382a7b-d104-4d64-99bd-51e237e18f5f)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Creating volume c25234ee-dc7c-467d-bdbf-39e5e9c022b6 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:45 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd4aa9b-0a3c-44c1-9ee8-87204d007b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48ad41c-662d-4bde-8343-952af01a8f7c', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:45 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 1073741824 Jul 09 15:11:45 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0385e18-da05-4453-85a4-7c58a434e941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:45 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Volume volume-a48ad41c-662d-4bde-8343-952af01a8f7c (a48ad41c-662d-4bde-8343-952af01a8f7c): created successfully Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0385e18-da05-4453-85a4-7c58a434e941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (646e268b-0e3e-4738-82f7-732fb4750ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-baec77b0-d080-4dfb-90b1-9f6a2b2483ee tempest-VolumesGetTest-560439043 None] Created volume successfully. Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (11d54c25-bd04-4dc3-a4a4-e6fc905fa1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548c519e-c89a-44c2-8801-f2c31c709d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548c519e-c89a-44c2-8801-f2c31c709d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1337775659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac999ac7-36f0-4f43-aa6d-30e981a9e6e7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a48ad41c-662d-4bde-8343-952af01a8f7c,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:46Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879e54cd-e419-4f03-9c1b-81e764887aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879e54cd-e419-4f03-9c1b-81e764887aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a7c99c-e15d-4ef7-a169-0ed1bac47332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a7c99c-e15d-4ef7-a169-0ed1bac47332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ac999ac7-36f0-4f43-aa6d-30e981a9e6e7', 'volume_name': 'volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7', 'volume_size': 1, 'source_volid': 'a48ad41c-662d-4bde-8343-952af01a8f7c', 'source_volstatus': 'available'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5270c736-7880-439f-8dbd-95582944e8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5270c736-7880-439f-8dbd-95582944e8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a69430-febb-4b13-9a0e-7df23205f3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:46 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Volume ac999ac7-36f0-4f43-aa6d-30e981a9e6e7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7', 'volume_size': 1, 'source_volid': 'a48ad41c-662d-4bde-8343-952af01a8f7c', 'source_volstatus': 'available'} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:46 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-13b6a54a-f4f1-409b-8af3-b4cff4d9bb89 req-8b24b5f2-86f7-4939-b2ea-49fda67a6a6d tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 1073741824" returned: 0 in 0.996s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:46 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 Jul 09 15:11:46 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:47 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" returned: 0 in 0.630s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.691s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:47 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Cloning volume a48ad41c-662d-4bde-8343-952af01a8f7c to volume ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6b5d3f-bb11-407d-b74b-3901caa520a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b0845a-105e-4db3-89d9-008102af89b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:47 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Volume volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 (c25234ee-dc7c-467d-bdbf-39e5e9c022b6): created successfully Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b0845a-105e-4db3-89d9-008102af89b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Flow 'volume_create_manager' (8ca3fbde-1e8c-4de7-8fc8-b49e9c5fa0a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Creating offline snapshot 5b60c40f-3684-4d3c-971f-1b97bb15b020 of volume a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:11:47 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f48a4713-ca18-4a89-a98b-3d05ef684473 tempest-GroupSnapshotsTest-1555359721 None] Created volume successfully. Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[366d68bc-17e8-4a40-9156-5c777333da7c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:47 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c Jul 09 15:11:47 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:48 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c" returned: 0 in 0.809s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:48 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 1G Jul 09 15:11:48 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Flow 'volume_create_manager' (c0d96d7e-d074-432d-804c-b16bf5c19023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef21dbe-a71f-43e2-b48d-f72343889c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef21dbe-a71f-43e2-b48d-f72343889c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1595488778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cd32bb9a-7745-4864-8933-ea72d3f15022,host='devstack@QuobyteHD#QuobyteHD',id=6e23816c-bd76-4698-b1fe-cc3c71321b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d649a8e13847f9978bf6302f6e0931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:49Z,use_quota=True,user_id='c4274bcd6e9b4b859cfd4bdd92d2774d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02382a7b-d104-4d64-99bd-51e237e18f5f),volume_type_id=02382a7b-d104-4d64-99bd-51e237e18f5f)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa73fe10-e6eb-4cff-9d35-3b0e4dc6a57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa73fe10-e6eb-4cff-9d35-3b0e4dc6a57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f2d329-e4d0-4b3b-a6da-f13423823572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f2d329-e4d0-4b3b-a6da-f13423823572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e23816c-bd76-4698-b1fe-cc3c71321b0a', 'volume_name': 'volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a630242-643b-4045-8596-32e0ce103bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a630242-643b-4045-8596-32e0ce103bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a7752b-ea18-4dac-a300-514116aac6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:48 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Volume 6e23816c-bd76-4698-b1fe-cc3c71321b0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a', 'volume_size': 1} Jul 09 15:11:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:49 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 1G" returned: 0 in 0.861s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48ad41c-662d-4bde-8343-952af01a8f7c -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:49 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48ad41c-662d-4bde-8343-952af01a8f7c -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 Jul 09 15:11:49 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:49 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48ad41c-662d-4bde-8343-952af01a8f7c -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020" returned: 0 in 0.909s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:50 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 is being set with open permissions: ugo+rw Jul 09 15:11:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:50 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 Jul 09 15:11:50 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:50 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020" returned: 0 in 0.670s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:50 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.info Jul 09 15:11:50 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:51 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.info" returned: 0 in 0.717s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:51 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.info is being set with open permissions: ugo+rw Jul 09 15:11:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:51 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.info Jul 09 15:11:51 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:52 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.info" returned: 0 in 0.676s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-quobyte-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] snapshot: 5b60c40f-3684-4d3c-971f-1b97bb15b020, volume: ac999ac7-36f0-4f43-aa6d-30e981a9e6e7, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5362992f-7e7e-4096-a241-9e7bc5dfee18]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:52 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 Jul 09 15:11:52 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:52 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020" returned: 0 in 0.798s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a48ad41c-662d-4bde-8343-952af01a8f7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:11:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:11:53 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2220f23-a61b-439f-a291-90e7b3db642f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:53 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c Jul 09 15:11:53 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:53 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c" returned: 0 in 0.781s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:53 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:11:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:53 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 Jul 09 15:11:53 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:59 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7" returned: 0 in 5.589s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:59 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a936ae4c-5056-4310-8418-11dbeaacf970]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:59 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c Jul 09 15:11:59 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:00 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c" returned: 0 in 0.952s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:00 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:12:00 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Converted 1024.00 MB image at 183.17 MB/s Jul 09 15:12:00 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 is being set with open permissions: ugo+rw Jul 09 15:12:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:00 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 Jul 09 15:12:00 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:00 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:INSERT=22,cinder:UPDATE=84,cinder:SELECT=74,cinder:DELETE=9 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:12:00 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=96,cinder:INSERT=19,cinder:UPDATE=94,cinder:DELETE=3 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:12:01 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7" returned: 0 in 0.693s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7" released by "_copy_volume_from_snapshot" :: held 8.918s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-quobyte-5b60c40f-3684-4d3c-971f-1b97bb15b020" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-5b60c40f-3684-4d3c-971f-1b97bb15b020" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Deleting offline snapshot 5b60c40f-3684-4d3c-971f-1b97bb15b020 of volume a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] snapshot_file for this snap is: volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0cd8f1-3e99-463d-beff-a11614ee38dd]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:01 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 Jul 09 15:12:01 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:01 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020" returned: 0 in 0.790s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a48ad41c-662d-4bde-8343-952af01a8f7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95ec6d8-344c-4748-804e-440414a2d8ce]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:02 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c Jul 09 15:12:02 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:02 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c" returned: 0 in 0.787s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:02 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 Jul 09 15:12:02 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:03 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020" returned: 0 in 0.730s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:03 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020 Jul 09 15:12:03 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:04 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c.5b60c40f-3684-4d3c-971f-1b97bb15b020" returned: 0 in 0.654s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-5b60c40f-3684-4d3c-971f-1b97bb15b020" released by "_delete_snapshot" :: held 3.060s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.857s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-13b6a54a-f4f1-409b-8af3-b4cff4d9bb89 req-8b24b5f2-86f7-4939-b2ea-49fda67a6a6d tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.522s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a69430-febb-4b13-9a0e-7df23205f3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7', 'volume_size': 1, 'source_volid': 'a48ad41c-662d-4bde-8343-952af01a8f7c', 'source_volstatus': 'available'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ddc95c-38c3-449c-b7c4-0935316c2521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6736f0f4-0328-4149-9519-36f79d4264d6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-13b6a54a-f4f1-409b-8af3-b4cff4d9bb89 req-8b24b5f2-86f7-4939-b2ea-49fda67a6a6d tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:04 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Volume volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 (ac999ac7-36f0-4f43-aa6d-30e981a9e6e7): created successfully Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ddc95c-38c3-449c-b7c4-0935316c2521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (11d54c25-bd04-4dc3-a4a4-e6fc905fa1cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:04 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c8fe956f-857d-4cb5-b585-7089d3da2e50 tempest-VolumesGetTest-560439043 None] Created volume successfully. Jul 09 15:12:04 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf Jul 09 15:12:04 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:04 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:04 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:05 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-13b6a54a-f4f1-409b-8af3-b4cff4d9bb89 req-8b24b5f2-86f7-4939-b2ea-49fda67a6a6d tempest-AttachVolumeTestJSON-2101523604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf" returned: 0 in 0.819s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-13b6a54a-f4f1-409b-8af3-b4cff4d9bb89 req-8b24b5f2-86f7-4939-b2ea-49fda67a6a6d tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.367s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cd32bb9a-7745-4864-8933-ea72d3f15022,created_at=2026-07-09T13:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1595488778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cd32bb9a-7745-4864-8933-ea72d3f15022,host='devstack@QuobyteHD#QuobyteHD',id=6e23816c-bd76-4698-b1fe-cc3c71321b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d649a8e13847f9978bf6302f6e0931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:49Z,use_quota=True,user_id='c4274bcd6e9b4b859cfd4bdd92d2774d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02382a7b-d104-4d64-99bd-51e237e18f5f),volume_type_id=02382a7b-d104-4d64-99bd-51e237e18f5f)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Creating volume 6e23816c-bd76-4698-b1fe-cc3c71321b0a {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:05 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:05 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a 1073741824 Jul 09 15:12:05 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-13b6a54a-f4f1-409b-8af3-b4cff4d9bb89 req-8b24b5f2-86f7-4939-b2ea-49fda67a6a6d tempest-AttachVolumeTestJSON-2101523604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1d0b6de-1504-4500-b12a-20d79844b62e', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:12:05 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-13b6a54a-f4f1-409b-8af3-b4cff4d9bb89 req-8b24b5f2-86f7-4939-b2ea-49fda67a6a6d tempest-AttachVolumeTestJSON-2101523604 None] attachment_update completed successfully. Jul 09 15:12:05 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.688s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 8 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (3c966868-d3d9-4f45-a8b7-8b293a812728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e11c1c-727b-459b-9955-b468ba7aa74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e11c1c-727b-459b-9955-b468ba7aa74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1275364551',display_name='tempest-VolumesGetTest-Volume-351753201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f558a48b-e5af-4529-a327-1100511ad50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:06Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c94539-1efd-4451-8d3b-7709c1621f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c94539-1efd-4451-8d3b-7709c1621f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acaefb60-c534-4071-9f55-2bed353b949c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acaefb60-c534-4071-9f55-2bed353b949c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f558a48b-e5af-4529-a327-1100511ad50e', 'volume_name': 'volume-f558a48b-e5af-4529-a327-1100511ad50e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac3fcb0-5861-4263-b1f1-79d220130e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac3fcb0-5861-4263-b1f1-79d220130e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a012b9b-0a8f-459d-97ae-a14f343b1fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:05 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Volume f558a48b-e5af-4529-a327-1100511ad50e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f558a48b-e5af-4529-a327-1100511ad50e', 'volume_size': 1} Jul 09 15:12:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:06 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a 1073741824" returned: 0 in 1.038s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:06 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a Jul 09 15:12:06 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:06 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a" returned: 0 in 0.726s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1275364551',display_name='tempest-VolumesGetTest-Volume-351753201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f558a48b-e5af-4529-a327-1100511ad50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:06Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Creating volume f558a48b-e5af-4529-a327-1100511ad50e {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:06 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a7752b-ea18-4dac-a300-514116aac6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:06 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e 1073741824 Jul 09 15:12:06 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5cb08f4-6338-43ca-a113-c5b65c2782ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:06 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Volume volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a (6e23816c-bd76-4698-b1fe-cc3c71321b0a): created successfully Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5cb08f4-6338-43ca-a113-c5b65c2782ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Flow 'volume_create_manager' (c0d96d7e-d074-432d-804c-b16bf5c19023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:06 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-03ebfca9-0c30-417b-83ab-ea5d5095f717 tempest-GroupSnapshotsTest-1555359721 None] Created volume successfully. Jul 09 15:12:07 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e 1073741824" returned: 0 in 1.006s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:07 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e Jul 09 15:12:07 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:08 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e4664511-004e-4336-a0cf-bb0082305e13 tempest-GroupSnapshotsTest-1555359721 None] Update group completed successfully. Jul 09 15:12:08 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e" returned: 0 in 0.712s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a012b9b-0a8f-459d-97ae-a14f343b1fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f558a48b-e5af-4529-a327-1100511ad50e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a75b71-422e-4340-a435-1aecb3028320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:08 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Volume volume-f558a48b-e5af-4529-a327-1100511ad50e (f558a48b-e5af-4529-a327-1100511ad50e): created successfully Jul 09 15:12:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a75b71-422e-4340-a435-1aecb3028320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (3c966868-d3d9-4f45-a8b7-8b293a812728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:08 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-85b85ac1-a60b-45cf-993f-6fc80cb28849 tempest-VolumesGetTest-560439043 None] Created volume successfully. Jul 09 15:12:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-f558a48b-e5af-4529-a327-1100511ad50e-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Lock "cinder-f558a48b-e5af-4529-a327-1100511ad50e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-quobyte-f558a48b-e5af-4529-a327-1100511ad50e" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-f558a48b-e5af-4529-a327-1100511ad50e" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:09 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c4d85e-ad31-45ab-8d69-d6ba239c59e3]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:09 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e Jul 09 15:12:09 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8cc43774-25c4-46e0-a9da-cc0551a35501 tempest-GroupSnapshotsTest-1555359721 None] Update group completed successfully. Jul 09 15:12:09 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e" returned: 0 in 0.872s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:10 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e Jul 09 15:12:10 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:10 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f558a48b-e5af-4529-a327-1100511ad50e" returned: 0 in 0.636s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-f558a48b-e5af-4529-a327-1100511ad50e" released by "delete_volume" :: held 1.556s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:10 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Created reservations ['62ff3866-e98c-4a28-886d-da788275962e', '969cf7bc-52ae-42de-9a28-173f93144d46', '5eb42c9c-8274-49fc-979f-4ead86bf1aa6', '261811ae-16e0-4042-b6ed-8ff90f7599dd'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:10 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:10 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:10 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8a92e81b-66c7-4113-82ae-b607c62c360f tempest-GroupSnapshotsTest-1555359721 None] Update group completed successfully. Jul 09 15:12:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-9f86720a-19bf-4d76-81b2-763f5ab16202 req-d4639c0f-5a53-4a1f-ab25-333eeafd3002 tempest-AttachVolumeTestJSON-2101523604 None] Terminate volume connection completed successfully. Jul 09 15:12:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-9f86720a-19bf-4d76-81b2-763f5ab16202 req-d4639c0f-5a53-4a1f-ab25-333eeafd3002 tempest-AttachVolumeTestJSON-2101523604 None] Deleting attachment cbac3410-1f5e-404d-9ad2-952f01819c94. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:12:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Lock "cinder-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-quobyte-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:11 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.867s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:11 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Deleted volume successfully. Jul 09 15:12:11 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2f4ad9-7f0a-41e2-8480-f9ec306e5a1e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3349c8b6-8180-4b0d-9f5d-0309da1fc5c3 tempest-VolumesGetTest-560439043 None] Lock "cinder-f558a48b-e5af-4529-a327-1100511ad50e-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:11 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 Jul 09 15:12:11 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:12 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6aedca63-e58f-463c-9d8f-0e4c08dc47f1 tempest-GroupSnapshotsTest-1555359721 None] Update group completed successfully. Jul 09 15:12:12 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7" returned: 0 in 1.167s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:12 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7 Jul 09 15:12:12 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:13 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7" returned: 0 in 0.854s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7" released by "delete_volume" :: held 2.105s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:13 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Created reservations ['32f55aa4-5240-481f-8faa-a6b2e3a8b349', 'd87d79cb-eec7-48e6-9e9e-348d86fb8810', 'f7449a45-6de6-446c-88ee-9d4afe6962f2', '64387b65-f98d-43ea-883a-118bf676916e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:14 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:14 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] GroupSnapshot 0d9c334c-8f16-4dfa-a6ff-18d7428efade: creating. Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Group snapshot 0d9c334c-8f16-4dfa-a6ff-18d7428efade: creating. {{(pid=87042) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 15:12:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-590ee5a8-cb02-4ad6-bdf8-41646e6e211c req-eb9218af-7eb6-4579-81d2-b71daca02665 tempest-AttachVolumeTestJSON-2101523604 None] Terminate volume connection completed successfully. Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-590ee5a8-cb02-4ad6-bdf8-41646e6e211c req-eb9218af-7eb6-4579-81d2-b71daca02665 tempest-AttachVolumeTestJSON-2101523604 None] Deleting attachment e1d0b6de-1504-4500-b12a-20d79844b62e. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Creating offline snapshot 0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 of volume 6e23816c-bd76-4698-b1fe-cc3c71321b0a {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[76842e3e-3bdc-4302-a0d1-4e19201c22b5]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:14 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a Jul 09 15:12:14 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:14 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.921s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:14 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Deleted volume successfully. Jul 09 15:12:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5d76bf2-94c5-4710-bf69-cc3d3b9061bf tempest-VolumesGetTest-560439043 None] Lock "cinder-ac999ac7-36f0-4f43-aa6d-30e981a9e6e7-delete_volume" released by "delete_volume" :: held 3.546s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-a48ad41c-662d-4bde-8343-952af01a8f7c-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Lock "cinder-a48ad41c-662d-4bde-8343-952af01a8f7c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:15 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a" returned: 0 in 1.115s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-quobyte-a48ad41c-662d-4bde-8343-952af01a8f7c" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-a48ad41c-662d-4bde-8343-952af01a8f7c" acquired by "delete_volume" :: waited 0.035s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:15 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 1G Jul 09 15:12:15 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:15 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc6bfc5-7db4-44bf-80dc-fd7c6b4bfbd0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:15 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c Jul 09 15:12:15 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:16 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 1G" returned: 0 in 1.052s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:16 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:16 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 Jul 09 15:12:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c" returned: 0 in 0.947s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:16 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:16 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c Jul 09 15:12:16 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:17 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a48ad41c-662d-4bde-8343-952af01a8f7c" returned: 0 in 0.998s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-a48ad41c-662d-4bde-8343-952af01a8f7c" released by "delete_volume" :: held 2.078s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:17 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8" returned: 0 in 1.106s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:17 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:17 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 Jul 09 15:12:17 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Created reservations ['52749d4e-9653-4c13-b0c4-9f3d84a592d5', 'ae3d4b19-b53a-4bb0-98d2-958b70d1a0bb', 'f7845b91-e058-4821-b8a2-4b1eb353d9b1', '75cd3961-7621-48e6-995a-56aeb1e63789'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:17 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:17 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:18 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8" returned: 0 in 0.829s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:18 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.info Jul 09 15:12:18 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:18 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.870s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:18 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:18 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Deleted volume successfully. Jul 09 15:12:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-60bf6e74-0b01-47ea-9e3d-d2d7dfae2576 tempest-VolumesGetTest-560439043 None] Lock "cinder-a48ad41c-662d-4bde-8343-952af01a8f7c-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:19 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.info" returned: 0 in 1.300s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:19 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:12:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:19 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.info Jul 09 15:12:19 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:20 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (0e53d31d-d36a-44fc-a820-9354d38304be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97363ad0-9bf6-4582-a926-025e7f3aae69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97363ad0-9bf6-4582-a926-025e7f3aae69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-386449277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7cd34d-6751-49ee-af91-2c748c75e17d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:21Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b426cffe-1f84-48c8-a04f-35052d036fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b426cffe-1f84-48c8-a04f-35052d036fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2fe34b-05fc-412f-aa73-145af531e2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG cinder.image.glance [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Creating Keystone auth plugin from conf {{(pid=87042) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:12:21 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.info" returned: 0 in 1.395s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.934s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Creating offline snapshot 83f5fa45-30f6-4372-801f-08c88a509fa4 of volume c25234ee-dc7c-467d-bdbf-39e5e9c022b6 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a898f2-1f91-4640-872d-33ad7ce4f882]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:21 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 Jul 09 15:12:21 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2fe34b-05fc-412f-aa73-145af531e2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e7cd34d-6751-49ee-af91-2c748c75e17d', 'volume_name': 'volume-5e7cd34d-6751-49ee-af91-2c748c75e17d', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1b4b59-d9ea-4885-8a57-eb569b733e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1b4b59-d9ea-4885-8a57-eb569b733e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5757e3a-e958-4dbc-b30b-f85996346d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Volume 5e7cd34d-6751-49ee-af91-2c748c75e17d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e7cd34d-6751-49ee-af91-2c748c75e17d', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 15:12:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Trying to clone 5e7cd34d-6751-49ee-af91-2c748c75e17d from image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]). {{(pid=87042) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:12:22 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:12:22 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Image download 20.69 MB at 20.69 MB/s Jul 09 15:12:22 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38d6847-2b17-4e3a-a289-bf2ebc1c0bdb]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:22 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD Jul 09 15:12:22 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:22 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" returned: 0 in 1.104s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:22 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 1G Jul 09 15:12:22 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:22 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD" returned: 0 in 0.841s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:22 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Temporary image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 is fetched for user 70e33295cda546f3b5ca5813022af7a2. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:12:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4ec1b9-b894-451e-a8a9-ccb2a18ce579]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:23 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD Jul 09 15:12:23 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:23 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 1G" returned: 0 in 0.917s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:23 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 Jul 09 15:12:23 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:23 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD" returned: 0 in 0.884s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:24 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4" returned: 0 in 0.815s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:24 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:12:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:24 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 Jul 09 15:12:24 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:24 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4" returned: 0 in 0.682s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:24 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.info Jul 09 15:12:24 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:25 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.info" returned: 0 in 0.751s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:25 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:12:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:25 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.info Jul 09 15:12:25 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "cinder-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "cinder-quobyte-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-quobyte-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:25 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17e9fa6-dab1-444c-ae94-ee194ee7b6b6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:26 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf Jul 09 15:12:26 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:26 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.info" returned: 0 in 0.770s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.198s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.393s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-386449277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7cd34d-6751-49ee-af91-2c748c75e17d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:21Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Creating volume 5e7cd34d-6751-49ee-af91-2c748c75e17d {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:26 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:26 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d 1073741824 Jul 09 15:12:26 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7fd84261-ab63-44a8-8a41-f0977e93df20 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot 0d9c334c-8f16-4dfa-a6ff-18d7428efade: created successfully Jul 09 15:12:26 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf" returned: 0 in 0.852s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:26 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf Jul 09 15:12:26 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:27 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot 0d9c334c-8f16-4dfa-a6ff-18d7428efade: deleting Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot 0d9c334c-8f16-4dfa-a6ff-18d7428efade: deleting {{(pid=87042) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-6e23816c-bd76-4698-b1fe-cc3c71321b0a" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-6e23816c-bd76-4698-b1fe-cc3c71321b0a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-0ccf41c7-91e7-4401-84a6-b70f67f4a2c8" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-0ccf41c7-91e7-4401-84a6-b70f67f4a2c8" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Deleting offline snapshot 0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 of volume 6e23816c-bd76-4698-b1fe-cc3c71321b0a {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] snapshot_file for this snap is: volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42d1e39-b0d7-4af7-82a6-88f8ab7b6b7c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:27 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d 1073741824" returned: 0 in 0.999s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:27 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d Jul 09 15:12:27 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:27 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 Jul 09 15:12:27 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:27 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf" returned: 0 in 0.804s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-quobyte-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf" released by "delete_volume" :: held 1.718s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Created reservations ['eef68121-a260-48e6-a42d-574e7f89721f', 'b7c91261-97ca-4f09-bef9-d1ef01195a1d', '504002d7-b3b8-4bc5-be41-a2334dc72512', 'bd73feb0-08f4-492e-b692-0a3601f97679'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:27 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:27 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "cinder-c125241f-b976-4c24-82ac-78823c753fd2-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-c125241f-b976-4c24-82ac-78823c753fd2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:28 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:28 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "cinder-quobyte-c125241f-b976-4c24-82ac-78823c753fd2" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8" returned: 0 in 0.920s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d" returned: 0 in 0.840s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[193f5af5-22c1-43ed-9178-182d9fdf412f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-quobyte-c125241f-b976-4c24-82ac-78823c753fd2" acquired by "delete_volume" :: waited 0.049s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[408b0b91-d182-4650-b435-1e3e7213e24c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Attempting download of 20626a8f-3a07-432c-b5dc-bd2614fa7a84 ((None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}])) to volume 5e7cd34d-6751-49ee-af91-2c748c75e17d. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:12:28 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a Jul 09 15:12:28 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2502b452-2d71-4e07-9d56-aca42078483b]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_muv94huw {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:28 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 Jul 09 15:12:28 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:28 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_muv94huw Jul 09 15:12:28 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:28 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.798s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:28 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Deleted volume successfully. Jul 09 15:12:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e237b27d-8a1f-42c1-b169-e8085b5e44b9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-2c814ce9-f6c4-4b4d-8f5f-9e99a9e746cf-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:29 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a" returned: 0 in 0.835s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:29 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 Jul 09 15:12:29 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:29 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2" returned: 0 in 0.856s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:29 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_muv94huw" returned: 0 in 0.785s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_muv94huw {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:29 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2 Jul 09 15:12:29 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:29 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_muv94huw Jul 09 15:12:29 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:29 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c125241f-b976-4c24-82ac-78823c753fd2" returned: 0 in 0.693s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-quobyte-c125241f-b976-4c24-82ac-78823c753fd2" released by "delete_volume" :: held 1.619s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:29 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8" returned: 0 in 0.804s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:29 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:29 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8 Jul 09 15:12:29 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_muv94huw" returned: 1 in 0.760s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_muv94huw' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa13905e-7660-4b2b-9ce8-07f11f82d16a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Created reservations ['c49a747e-9e65-4f36-b122-7dbfad125101', 'fad971f8-73ae-4322-aca4-d05db8804ad6', '5d3dccc4-6b25-4c23-badd-0e9c83a7d252', '2f58ea5c-d82e-457a-a0e6-1680464bfdcd'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:30 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD Jul 09 15:12:30 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:30 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:30 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "cinder-f516d89e-6ef1-477e-9716-fd5cf5e47e41-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-f516d89e-6ef1-477e-9716-fd5cf5e47e41-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "cinder-quobyte-f516d89e-6ef1-477e-9716-fd5cf5e47e41" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-quobyte-f516d89e-6ef1-477e-9716-fd5cf5e47e41" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe696e00-a41d-4290-afb4-01806a295d8d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:30 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a.0ccf41c7-91e7-4401-84a6-b70f67f4a2c8" returned: 0 in 0.803s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-0ccf41c7-91e7-4401-84a6-b70f67f4a2c8" released by "_delete_snapshot" :: held 3.494s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:30 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-6e23816c-bd76-4698-b1fe-cc3c71321b0a" released by "delete_snapshot" :: held 3.532s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:30 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-83f5fa45-30f6-4372-801f-08c88a509fa4" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-83f5fa45-30f6-4372-801f-08c88a509fa4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Deleting offline snapshot 83f5fa45-30f6-4372-801f-08c88a509fa4 of volume c25234ee-dc7c-467d-bdbf-39e5e9c022b6 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] snapshot_file for this snap is: volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:12:30 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.772s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:30 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Deleted volume successfully. Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e423204-0a5b-48d8-a5df-601f810e4985]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:30 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD" returned: 0 in 0.964s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] 20626a8f-3a07-432c-b5dc-bd2614fa7a84 was qcow2, converting to raw {{(pid=87042) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-961a6ffb-12df-4569-b43e-aaa4a761dbc9 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-c125241f-b976-4c24-82ac-78823c753fd2-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:30 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d Jul 09 15:12:30 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:30 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 Jul 09 15:12:30 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:31 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41" returned: 0 in 0.876s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:31 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41 Jul 09 15:12:31 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:31 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4" returned: 0 in 0.865s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:12:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2466f464-0fbd-40b2-b4fa-547fa4daf825]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:31 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 Jul 09 15:12:31 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:32 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f516d89e-6ef1-477e-9716-fd5cf5e47e41" returned: 0 in 0.809s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-quobyte-f516d89e-6ef1-477e-9716-fd5cf5e47e41" released by "delete_volume" :: held 1.755s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Created reservations ['9ee82133-8d41-41d1-b163-35c0020137ce', '28e89f40-f091-42f9-be9c-09d5d90dc2c1', '44f02ba5-897d-4a0d-bac5-24da9856ef88', 'b9e4bd28-ddc5-403a-96c9-43a070160769'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:32 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:32 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:32 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" returned: 0 in 1.097s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:32 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 Jul 09 15:12:32 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:33 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d" returned: 0 in 2.431s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:33 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_yd4n5h85devstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:12:33 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Converted 112.00 MB image at 46.05 MB/s Jul 09 15:12:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:33 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d 1G Jul 09 15:12:33 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:33 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.938s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:33 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:33 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Deleted volume successfully. Jul 09 15:12:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-161f5c26-4d00-4a73-8b81-41b137e465b7 tempest-AttachVolumeTestJSON-2101523604 None] Lock "cinder-f516d89e-6ef1-477e-9716-fd5cf5e47e41-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:33 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4" returned: 0 in 1.054s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:33 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4 Jul 09 15:12:33 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:34 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d 1G" returned: 0 in 0.830s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:34 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[3539ebea-f719-4a85-91fb-34a8745b20ec]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:34 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d Jul 09 15:12:34 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:34 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6.83f5fa45-30f6-4372-801f-08c88a509fa4" returned: 0 in 0.760s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-83f5fa45-30f6-4372-801f-08c88a509fa4" released by "_delete_snapshot" :: held 3.911s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" released by "delete_snapshot" :: held 3.941s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:34 devstack cinder-volume[87042]: WARNING cinder.quota [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1238281940 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1238281940, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:12:34 devstack cinder-volume[87042]: WARNING cinder.quota [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1238281940 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1238281940, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:12:34 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['49063659-7e7d-436c-ba41-11cada63b343', '8d313919-9c1a-44bf-9fa6-22c3b060e438', '10d25bb0-7759-4364-951a-c88d4ef03bbf', '0d464c63-254b-4e1c-98fd-c4a7892a534a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:34 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['2485d750-92c6-4054-8271-98efb6e7125b', '8eafb28e-3b40-4911-9733-707d932dac99', 'b9529261-43f4-4246-b226-ca31221e9dce', '2e4a4a73-f73c-4389-a746-e8d32cbe1cc5'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:35 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d" returned: 0 in 0.810s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-25ebd9d2-5cfd-4940-9ae6-907ca2eecd68 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot 0d9c334c-8f16-4dfa-a6ff-18d7428efade: deleted successfully Jul 09 15:12:35 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d Jul 09 15:12:35 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:35 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d" returned: 1 in 0.780s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:12:35 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Downloaded image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 ((None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}])) to volume 5e7cd34d-6751-49ee-af91-2c748c75e17d successfully. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:12:35 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Temporary image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 for user 70e33295cda546f3b5ca5813022af7a2 is deleted. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:12:35 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Marking volume 5e7cd34d-6751-49ee-af91-2c748c75e17d as bootable. {{(pid=87042) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:12:35 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Copying metadata from image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 to 5e7cd34d-6751-49ee-af91-2c748c75e17d. {{(pid=87042) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:12:35 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Creating volume glance metadata for volume 5e7cd34d-6751-49ee-af91-2c748c75e17d backed by image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87042) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:12:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5757e3a-e958-4dbc-b30b-f85996346d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7cd34d-6751-49ee-af91-2c748c75e17d', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d7f50d-4815-4033-ab7e-6ae2bebc33ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:36 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Volume volume-5e7cd34d-6751-49ee-af91-2c748c75e17d (5e7cd34d-6751-49ee-af91-2c748c75e17d): created successfully Jul 09 15:12:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d7f50d-4815-4033-ab7e-6ae2bebc33ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (0e53d31d-d36a-44fc-a820-9354d38304be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6e65a3ec-7e33-4190-bd3a-7e7b7d844adb tempest-VolumesGetTest-560439043 None] Created volume successfully. Jul 09 15:12:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-6e23816c-bd76-4698-b1fe-cc3c71321b0a" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-6e23816c-bd76-4698-b1fe-cc3c71321b0a" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:36 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8097f9f-3153-4563-9759-ad8ba27e9e67]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:36 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a Jul 09 15:12:36 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:37 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a" returned: 0 in 0.883s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:37 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a Jul 09 15:12:37 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (d81c666a-8526-4bc4-8a5a-1c87b6f58567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049e58a1-e7c8-4248-9e57-dcbe0c66dfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049e58a1-e7c8-4248-9e57-dcbe0c66dfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-95087805',display_name='tempest-VolumesGetTest-Volume-675877208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b23b41-e74d-4707-a853-93cb3e046161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:38Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0139db3f-77d8-487f-ab66-9397d8acd9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0139db3f-77d8-487f-ab66-9397d8acd9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11715b2c-550c-4007-8fa0-06648b88b978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11715b2c-550c-4007-8fa0-06648b88b978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b23b41-e74d-4707-a853-93cb3e046161', 'volume_name': 'volume-14b23b41-e74d-4707-a853-93cb3e046161', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103e4f54-d6f4-4857-9b9d-11a7521d72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103e4f54-d6f4-4857-9b9d-11a7521d72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b87452-10cd-436a-96ab-ae9f3e173699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:37 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Volume 14b23b41-e74d-4707-a853-93cb3e046161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b23b41-e74d-4707-a853-93cb3e046161', 'volume_size': 1} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-95087805',display_name='tempest-VolumesGetTest-Volume-675877208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b23b41-e74d-4707-a853-93cb3e046161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c38445084274473972cbcfe50d7353c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:38Z,use_quota=True,user_id='70e33295cda546f3b5ca5813022af7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Creating volume 14b23b41-e74d-4707-a853-93cb3e046161 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:37 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:12:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:37 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161 1073741824 Jul 09 15:12:37 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:38 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e23816c-bd76-4698-b1fe-cc3c71321b0a" returned: 0 in 0.785s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-6e23816c-bd76-4698-b1fe-cc3c71321b0a" released by "delete_volume" :: held 1.778s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:38 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fc8f7c-a9f1-4fcc-9412-f7451dd61e3d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:38 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 Jul 09 15:12:38 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:38 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161 1073741824" returned: 0 in 1.098s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:38 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161 Jul 09 15:12:38 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:39 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" returned: 0 in 0.961s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:39 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6 Jul 09 15:12:39 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Flow 'volume_create_manager' (cfefd6e7-9e55-49ba-a123-6dc5e38c003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b0a229-d4e5-45a8-9756-bf834031b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b0a229-d4e5-45a8-9756-bf834031b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1302622036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55d32f2-b967-418a-a1ba-8fd721ee0f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162fc8e028e549f5a23d2a0f609f7ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:39Z,use_quota=True,user_id='27fa6a2d907543d2a31f40aa5297b26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8e3f3e-dab0-471d-9bf9-f773cdcf2374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8e3f3e-dab0-471d-9bf9-f773cdcf2374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c8ddb4-f068-4e10-972b-9ec613b180d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c8ddb4-f068-4e10-972b-9ec613b180d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55d32f2-b967-418a-a1ba-8fd721ee0f14', 'volume_name': 'volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fab691-184d-4315-8e72-fe72f5a3dd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fab691-184d-4315-8e72-fe72f5a3dd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13b673f-7fa3-458e-8da1-f8c13a30c080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:39 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Volume a55d32f2-b967-418a-a1ba-8fd721ee0f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14', 'volume_size': 1} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:39 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161" returned: 0 in 0.851s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.295s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1302622036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55d32f2-b967-418a-a1ba-8fd721ee0f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162fc8e028e549f5a23d2a0f609f7ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:39Z,use_quota=True,user_id='27fa6a2d907543d2a31f40aa5297b26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Creating volume a55d32f2-b967-418a-a1ba-8fd721ee0f14 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:39 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b87452-10cd-436a-96ab-ae9f3e173699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b23b41-e74d-4707-a853-93cb3e046161', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb7b17d-aa39-43c7-8963-237fd984437a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:39 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 1073741824 Jul 09 15:12:39 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:39 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Volume volume-14b23b41-e74d-4707-a853-93cb3e046161 (14b23b41-e74d-4707-a853-93cb3e046161): created successfully Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb7b17d-aa39-43c7-8963-237fd984437a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Flow 'volume_create_manager' (d81c666a-8526-4bc4-8a5a-1c87b6f58567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:39 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1b9b2a3b-bdf8-45c9-b55c-94d8e43f84ad tempest-VolumesGetTest-560439043 None] Created volume successfully. Jul 09 15:12:39 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" returned: 0 in 0.788s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-c25234ee-dc7c-467d-bdbf-39e5e9c022b6" released by "delete_volume" :: held 1.828s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['b948137e-2ce7-4bd1-a429-607498c6b884'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:40 devstack cinder-volume[87042]: WARNING cinder.quota [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1238281940 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1238281940, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['b178fe77-ee16-4fec-8b80-ac20e9e65c7f', 'ce83c5e5-985f-4159-a29e-cbd9a32b2fb2', 'baa113db-676e-4733-b5a9-dce1f03a3bc6', '63c8b567-9a43-4e51-8355-98d789bda7ed'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['4685cf70-68df-42db-8ce8-de1fe52afec3', '77dbb890-f57c-404b-b953-99368bb87c4c', '8560ea31-dc02-4794-a94a-e99078e0860b', 'fd333cc9-94ed-4bce-b0a0-8c21454f8bdc'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:40 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:40 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:40 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 1073741824" returned: 0 in 1.021s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:40 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 Jul 09 15:12:40 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-14b23b41-e74d-4707-a853-93cb3e046161-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Lock "cinder-14b23b41-e74d-4707-a853-93cb3e046161-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-quobyte-14b23b41-e74d-4707-a853-93cb3e046161" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-14b23b41-e74d-4707-a853-93cb3e046161" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc00cd64-0550-4538-b045-03d50b9c09de]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:41 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.864s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-584bfc38-518c-4281-8dba-ce65a9958500 tempest-GroupSnapshotsTest-1555359721 None] Delete group completed successfully. Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:41 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161 Jul 09 15:12:41 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Flow 'volume_create_manager' (8b386d75-85a5-4a4e-9c4d-8e2a0f65289f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9611684d-ef24-413f-878c-dd77383c5886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9611684d-ef24-413f-878c-dd77383c5886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-366940443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbda831-4b0d-48a1-979b-a35a37e640d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab924c2673034717b48d7b079869216a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:41Z,use_quota=True,user_id='cf0c3857a1bb48768682b1a2cc815ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82781b63-070d-4478-8f28-c7977fc3e65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82781b63-070d-4478-8f28-c7977fc3e65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53e5ba6-6165-4d3b-b99a-268c076e7c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53e5ba6-6165-4d3b-b99a-268c076e7c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fbda831-4b0d-48a1-979b-a35a37e640d4', 'volume_name': 'volume-2fbda831-4b0d-48a1-979b-a35a37e640d4', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc24173d-1942-48eb-896c-c4dd5bb5e09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc24173d-1942-48eb-896c-c4dd5bb5e09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbdafbc-92e7-4ec6-ba2d-1349839a9440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:41 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Volume 2fbda831-4b0d-48a1-979b-a35a37e640d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fbda831-4b0d-48a1-979b-a35a37e640d4', 'volume_size': 1} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-aca78756-4797-4efc-aefa-4642b9ae7e76 tempest-GroupSnapshotsTest-1555359721 None] Group tempest-GroupSnapshotsTest-Group-2001714955: creating Jul 09 15:12:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-aca78756-4797-4efc-aefa-4642b9ae7e76 tempest-GroupSnapshotsTest-1555359721 None] Group tempest-GroupSnapshotsTest-Group-2001714955: created successfully Jul 09 15:12:41 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14" returned: 0 in 0.901s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-aca78756-4797-4efc-aefa-4642b9ae7e76 tempest-GroupSnapshotsTest-1555359721 None] Create group completed successfully. Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-366940443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbda831-4b0d-48a1-979b-a35a37e640d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab924c2673034717b48d7b079869216a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:41Z,use_quota=True,user_id='cf0c3857a1bb48768682b1a2cc815ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Creating volume 2fbda831-4b0d-48a1-979b-a35a37e640d4 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:41 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:41 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4 1073741824 Jul 09 15:12:41 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13b673f-7fa3-458e-8da1-f8c13a30c080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e822ac-422e-4baf-8cc5-92a66491e295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:41 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Volume volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 (a55d32f2-b967-418a-a1ba-8fd721ee0f14): created successfully Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e822ac-422e-4baf-8cc5-92a66491e295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Flow 'volume_create_manager' (cfefd6e7-9e55-49ba-a123-6dc5e38c003b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-121cb751-626d-4f63-854d-aa93a2b0f6a0 tempest-AttachVolumeNegativeTest-2087590681 None] Created volume successfully. Jul 09 15:12:42 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161" returned: 0 in 0.896s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:42 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161 Jul 09 15:12:42 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:42 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4 1073741824" returned: 0 in 0.893s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:42 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4 Jul 09 15:12:42 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:42 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-14b23b41-e74d-4707-a853-93cb3e046161" returned: 0 in 0.708s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-14b23b41-e74d-4707-a853-93cb3e046161" released by "delete_volume" :: held 1.690s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Created reservations ['de67bf25-9a0a-4886-afc9-3a8554c2de07', '7b78a3ea-b480-43d4-9c4c-95e0cfd2a96f', 'a759f9a3-32bb-4ffc-8034-85581d03caea', 'ec804e44-7559-4e35-b08d-4056618b976a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:42 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:42 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-5e7cd34d-6751-49ee-af91-2c748c75e17d-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Lock "cinder-5e7cd34d-6751-49ee-af91-2c748c75e17d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Acquiring lock "cinder-quobyte-5e7cd34d-6751-49ee-af91-2c748c75e17d" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-5e7cd34d-6751-49ee-af91-2c748c75e17d" acquired by "delete_volume" :: waited 0.058s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:43 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4" returned: 0 in 0.858s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Flow 'volume_create_manager' (9a98cb4b-ba29-4e46-946e-9bd00ddb26bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25546c6-c13e-41d9-9012-b23d7b55d29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6266d65e-a03a-4754-9d70-19dba4a9de05]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbdafbc-92e7-4ec6-ba2d-1349839a9440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbda831-4b0d-48a1-979b-a35a37e640d4', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f0784a-6778-4cd0-b621-5aa9d4750f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25546c6-c13e-41d9-9012-b23d7b55d29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-284231452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=26839d79-4457-4c46-a62d-c0d493fad990,host='devstack@QuobyteHD#QuobyteHD',id=6e3cdda0-f7d7-4446-beb4-d2a2d2c81522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d649a8e13847f9978bf6302f6e0931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:43Z,use_quota=True,user_id='c4274bcd6e9b4b859cfd4bdd92d2774d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ec9e01b-e617-40bb-8341-3f68a649e910),volume_type_id=6ec9e01b-e617-40bb-8341-3f68a649e910)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746745bb-0a81-4411-a0f5-9a298b6bfab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746745bb-0a81-4411-a0f5-9a298b6bfab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7595311d-8d08-4dd9-abf5-03d714dcabc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7595311d-8d08-4dd9-abf5-03d714dcabc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3cdda0-f7d7-4446-beb4-d2a2d2c81522', 'volume_name': 'volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4171f3b-a635-4d03-83cc-6cb2af25e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4171f3b-a635-4d03-83cc-6cb2af25e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c829e5e-203c-44e8-a5dc-0d356764f464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:43 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Volume 6e3cdda0-f7d7-4446-beb4-d2a2d2c81522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522', 'volume_size': 1} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=26839d79-4457-4c46-a62d-c0d493fad990,created_at=2026-07-09T13:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-284231452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=26839d79-4457-4c46-a62d-c0d493fad990,host='devstack@QuobyteHD#QuobyteHD',id=6e3cdda0-f7d7-4446-beb4-d2a2d2c81522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d649a8e13847f9978bf6302f6e0931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:43Z,use_quota=True,user_id='c4274bcd6e9b4b859cfd4bdd92d2774d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ec9e01b-e617-40bb-8341-3f68a649e910),volume_type_id=6ec9e01b-e617-40bb-8341-3f68a649e910)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Creating volume 6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:43 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:43 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.825s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:43 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d Jul 09 15:12:43 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:43 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Deleted volume successfully. Jul 09 15:12:43 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Volume volume-2fbda831-4b0d-48a1-979b-a35a37e640d4 (2fbda831-4b0d-48a1-979b-a35a37e640d4): created successfully Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f0784a-6778-4cd0-b621-5aa9d4750f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:43 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 1073741824 Jul 09 15:12:43 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Flow 'volume_create_manager' (8b386d75-85a5-4a4e-9c4d-8e2a0f65289f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:43 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-214f811b-d99b-42a8-9d1c-cc5029dfd417 req-2de425be-6ff2-414f-b72f-26ed97210390 tempest-VolumesGetTestJSON-371702345 None] Created volume successfully. Jul 09 15:12:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fd2bdb66-6ac0-4eac-8429-94bcd86163e4 tempest-VolumesGetTest-560439043 None] Lock "cinder-14b23b41-e74d-4707-a853-93cb3e046161-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:44 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d" returned: 0 in 0.785s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:44 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d Jul 09 15:12:44 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:44 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 1073741824" returned: 0 in 0.860s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:44 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 Jul 09 15:12:44 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Acquiring lock "cinder-2fbda831-4b0d-48a1-979b-a35a37e640d4-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Lock "cinder-2fbda831-4b0d-48a1-979b-a35a37e640d4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Acquiring lock "cinder-quobyte-2fbda831-4b0d-48a1-979b-a35a37e640d4" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Lock "cinder-quobyte-2fbda831-4b0d-48a1-979b-a35a37e640d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d385ab-1800-4927-9cd0-8712f78434de]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:45 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4 Jul 09 15:12:45 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:45 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d" returned: 1 in 0.928s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:45 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d Jul 09 15:12:45 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:45 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" returned: 0 in 0.822s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c829e5e-203c-44e8-a5dc-0d356764f464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4bffce-60f9-4978-8918-8c1fcf49f6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:45 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Volume volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 (6e3cdda0-f7d7-4446-beb4-d2a2d2c81522): created successfully Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4bffce-60f9-4978-8918-8c1fcf49f6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Flow 'volume_create_manager' (9a98cb4b-ba29-4e46-946e-9bd00ddb26bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1bba19f0-92b8-4d48-aa34-bfb929e4615a tempest-GroupSnapshotsTest-1555359721 None] Created volume successfully. Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-6856ac77-6132-421d-b033-b24dae5e06b6 req-a6ec105c-2c0c-4a82-8071-98aca5e14754 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-6856ac77-6132-421d-b033-b24dae5e06b6 req-a6ec105c-2c0c-4a82-8071-98aca5e14754 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dce96c4-763a-4efb-9128-33efd62269c8]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-6856ac77-6132-421d-b033-b24dae5e06b6 req-a6ec105c-2c0c-4a82-8071-98aca5e14754 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:45 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 Jul 09 15:12:45 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:45 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4" returned: 0 in 0.843s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:46 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4 Jul 09 15:12:46 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:46 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5e7cd34d-6751-49ee-af91-2c748c75e17d" returned: 0 in 0.784s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Lock "cinder-quobyte-5e7cd34d-6751-49ee-af91-2c748c75e17d" released by "delete_volume" :: held 2.602s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Created reservations ['4964ea36-1273-4cbd-9a9d-b8f395d08a08', '135a177b-5c8f-44f5-841c-9d4244241cda', '9245f1ca-2b25-44ca-ab24-9c15968964c7', 'dd39b67b-f16f-491a-9cbd-19c6718b042a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:46 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] GroupSnapshot 61dd1cb9-2303-415e-87bc-7f680190646b: creating. Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Group snapshot 61dd1cb9-2303-415e-87bc-7f680190646b: creating. {{(pid=87042) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:46 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:46 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:46 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-6856ac77-6132-421d-b033-b24dae5e06b6 req-a6ec105c-2c0c-4a82-8071-98aca5e14754 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14" returned: 0 in 0.934s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-6856ac77-6132-421d-b033-b24dae5e06b6 req-a6ec105c-2c0c-4a82-8071-98aca5e14754 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.956s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.272s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Creating offline snapshot e5d3fd36-b1b9-419c-b089-440e4552d284 of volume 6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd080d7-04a2-4360-baeb-324ebdbf4830]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-6856ac77-6132-421d-b033-b24dae5e06b6 req-a6ec105c-2c0c-4a82-8071-98aca5e14754 tempest-AttachVolumeNegativeTest-2087590681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c2c968b-38ac-4254-a19e-618b6d05d4ce', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:12:46 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-6856ac77-6132-421d-b033-b24dae5e06b6 req-a6ec105c-2c0c-4a82-8071-98aca5e14754 tempest-AttachVolumeNegativeTest-2087590681 None] attachment_update completed successfully. Jul 09 15:12:46 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 Jul 09 15:12:46 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:46 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fbda831-4b0d-48a1-979b-a35a37e640d4" returned: 0 in 0.870s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Lock "cinder-quobyte-2fbda831-4b0d-48a1-979b-a35a37e640d4" released by "delete_volume" :: held 1.788s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:46 devstack cinder-volume[87042]: DEBUG cinder.quota [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Created reservations ['bae216c3-c125-4ab9-883b-f66e1b844626', '90421153-cbec-4df1-a0ad-be1dee77dcc8', '8f2c0f99-1e72-4415-b797-2f93d64e6a22', '7c5aa26d-abf4-4512-969f-1159eb1998d5'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:47 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:12:47 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:47 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.837s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:47 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Deleted volume successfully. Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-33c677d8-3101-4197-8f4f-47c1d553611d tempest-VolumesGetTest-560439043 None] Lock "cinder-5e7cd34d-6751-49ee-af91-2c748c75e17d-delete_volume" released by "delete_volume" :: held 3.811s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:47 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" returned: 0 in 0.978s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:47 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 1G Jul 09 15:12:47 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:47 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.956s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:47 devstack cinder-volume[87042]: DEBUG cinder.manager [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:47 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Deleted volume successfully. Jul 09 15:12:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-8ee54ab9-8f0e-4797-bbaa-3dc9d029a448 req-2ae7aad5-f355-49e4-8d33-dcf83c85cc45 tempest-VolumesGetTestJSON-371702345 None] Lock "cinder-2fbda831-4b0d-48a1-979b-a35a37e640d4-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:48 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 1G" returned: 0 in 1.076s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:48 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 Jul 09 15:12:48 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:49 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284" returned: 0 in 0.819s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:49 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:12:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:49 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 Jul 09 15:12:49 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:50 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284" returned: 0 in 0.744s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:50 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.info Jul 09 15:12:50 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:51 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.info" returned: 0 in 0.791s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:51 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:12:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:51 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.info Jul 09 15:12:51 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:51 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.info" returned: 0 in 0.711s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.247s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:51 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Flow 'volume_create_manager' (d6fd1fe9-1047-4550-a898-008537011bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80cd3eb-51c1-4fd6-8191-977c2f510b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:52 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ed21b05d-b1e4-4e65-92a5-665409b50e6c tempest-GroupSnapshotsTest-1555359721 None] group_snapshot 61dd1cb9-2303-415e-87bc-7f680190646b: created successfully Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80cd3eb-51c1-4fd6-8191-977c2f510b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-757952198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948a7678-16f9-4c59-b1ed-41bf85aa8847,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13308701a9254dde9ad1c3000e453e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:52Z,use_quota=True,user_id='7be3ffe589014de7866f0c332ea12181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c787b5b7-5ba4-4520-b0d4-359a185a7fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c787b5b7-5ba4-4520-b0d4-359a185a7fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697d609e-d970-4e77-a925-7b529bf2bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697d609e-d970-4e77-a925-7b529bf2bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948a7678-16f9-4c59-b1ed-41bf85aa8847', 'volume_name': 'volume-948a7678-16f9-4c59-b1ed-41bf85aa8847', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f726b993-1b38-47dc-8506-d8556fb32fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f726b993-1b38-47dc-8506-d8556fb32fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7692a49e-1180-44fb-8bc5-a67851f8cc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:52 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Volume 948a7678-16f9-4c59-b1ed-41bf85aa8847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948a7678-16f9-4c59-b1ed-41bf85aa8847', 'volume_size': 1} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-757952198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948a7678-16f9-4c59-b1ed-41bf85aa8847,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13308701a9254dde9ad1c3000e453e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:52Z,use_quota=True,user_id='7be3ffe589014de7866f0c332ea12181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Creating volume 948a7678-16f9-4c59-b1ed-41bf85aa8847 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:52 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:52 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847 1073741824 Jul 09 15:12:52 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:52 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot 61dd1cb9-2303-415e-87bc-7f680190646b: deleting Jul 09 15:12:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot 61dd1cb9-2303-415e-87bc-7f680190646b: deleting {{(pid=87042) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 15:12:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-e5d3fd36-b1b9-419c-b089-440e4552d284" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-e5d3fd36-b1b9-419c-b089-440e4552d284" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Deleting offline snapshot e5d3fd36-b1b9-419c-b089-440e4552d284 of volume 6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:12:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] snapshot_file for this snap is: volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:12:53 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efef2aa-e33c-48a5-8a5e-f2458a6e6de2]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:53 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847 1073741824" returned: 0 in 0.986s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:53 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847 Jul 09 15:12:53 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:53 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 Jul 09 15:12:53 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:54 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-d3fc2d0d-056a-4532-a7c4-4296098b8aea req-e15dd021-e6b5-485f-b986-975dafd5fd2b tempest-AttachVolumeNegativeTest-2087590681 None] Terminate volume connection completed successfully. Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-d3fc2d0d-056a-4532-a7c4-4296098b8aea req-e15dd021-e6b5-485f-b986-975dafd5fd2b tempest-AttachVolumeNegativeTest-2087590681 None] Deleting attachment 5c2c968b-38ac-4254-a19e-618b6d05d4ce. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:12:54 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847" returned: 0 in 0.930s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7692a49e-1180-44fb-8bc5-a67851f8cc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948a7678-16f9-4c59-b1ed-41bf85aa8847', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:54 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbf266c-0670-4279-8508-065740eab48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284" returned: 0 in 1.041s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:12:54 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Volume volume-948a7678-16f9-4c59-b1ed-41bf85aa8847 (948a7678-16f9-4c59-b1ed-41bf85aa8847): created successfully Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbf266c-0670-4279-8508-065740eab48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Flow 'volume_create_manager' (d6fd1fe9-1047-4550-a898-008537011bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ef992f-2cbb-4aa2-9eec-cba907cb7521]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:54 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-46cd347e-e479-48ba-8902-6b7a1f9c8fd4 tempest-VolumesTestJSON-47256238 None] Created volume successfully. Jul 09 15:12:54 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 Jul 09 15:12:54 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:54 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" returned: 0 in 0.799s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:54 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 Jul 09 15:12:54 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:55 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284" returned: 0 in 0.855s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:55 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284 Jul 09 15:12:55 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Flow 'volume_create_manager' (55d0b733-413a-42d3-86c6-09d661d3dfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6555b6-1263-45a3-8287-2e2d618051f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6555b6-1263-45a3-8287-2e2d618051f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1747673317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87ec1bc-2a90-442d-a29d-599b72ed2610,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13308701a9254dde9ad1c3000e453e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:56Z,use_quota=True,user_id='7be3ffe589014de7866f0c332ea12181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf31203d-cba0-42b8-aa59-973b7b76495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf31203d-cba0-42b8-aa59-973b7b76495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb016ba4-6c3c-4526-b3a1-c292577a8b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb016ba4-6c3c-4526-b3a1-c292577a8b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87ec1bc-2a90-442d-a29d-599b72ed2610', 'volume_name': 'volume-a87ec1bc-2a90-442d-a29d-599b72ed2610', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7987d05-643a-4a32-9892-452b5f184c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7987d05-643a-4a32-9892-452b5f184c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc1b8eb-7199-47ba-99cd-c6c219c2d708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Volume a87ec1bc-2a90-442d-a29d-599b72ed2610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87ec1bc-2a90-442d-a29d-599b72ed2610', 'volume_size': 1} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1747673317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87ec1bc-2a90-442d-a29d-599b72ed2610,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13308701a9254dde9ad1c3000e453e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:56Z,use_quota=True,user_id='7be3ffe589014de7866f0c332ea12181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Creating volume a87ec1bc-2a90-442d-a29d-599b72ed2610 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:56 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:56 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610 1073741824 Jul 09 15:12:56 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:56 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522.e5d3fd36-b1b9-419c-b089-440e4552d284" returned: 0 in 1.032s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-e5d3fd36-b1b9-419c-b089-440e4552d284" released by "_delete_snapshot" :: held 3.858s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" released by "delete_snapshot" :: held 3.884s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:57 devstack cinder-volume[87042]: WARNING cinder.quota [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1384690761 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1384690761, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:12:57 devstack cinder-volume[87042]: WARNING cinder.quota [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1384690761 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1384690761, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:12:57 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['6c5d8ebc-655b-4d51-8d0a-02f1745a78fe', '566a07b8-68a6-4829-bf0f-f0ace78aa39e', '838acd3b-3ed7-4b25-b523-d5e81acb52ab', '6381d9cc-d784-42ec-90d5-e955a0c0488c'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:57 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-51d9ba9f-b128-43e7-9427-93cf161c7500 tempest-GroupSnapshotsTest-1555359721 None] group_snapshot 61dd1cb9-2303-415e-87bc-7f680190646b: deleted successfully Jul 09 15:12:57 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610 1073741824" returned: 0 in 1.156s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:57 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610 Jul 09 15:12:57 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "cinder-quobyte-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:57 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[858b83b9-3ce5-45a3-8180-23179868bef7]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:58 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610" returned: 0 in 0.825s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc1b8eb-7199-47ba-99cd-c6c219c2d708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87ec1bc-2a90-442d-a29d-599b72ed2610', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088b2683-d4e0-4773-a186-175a5430dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:58 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Volume volume-a87ec1bc-2a90-442d-a29d-599b72ed2610 (a87ec1bc-2a90-442d-a29d-599b72ed2610): created successfully Jul 09 15:12:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088b2683-d4e0-4773-a186-175a5430dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Flow 'volume_create_manager' (55d0b733-413a-42d3-86c6-09d661d3dfca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:58 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 Jul 09 15:12:58 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:58 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-dd09c20b-39b3-4a4c-bd61-b0d7af47ea43 tempest-VolumesTestJSON-47256238 None] Created volume successfully. Jul 09 15:12:59 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" returned: 0 in 1.117s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:59 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522 Jul 09 15:12:59 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:59 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" returned: 0 in 0.900s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Lock "cinder-quobyte-6e3cdda0-f7d7-4446-beb4-d2a2d2c81522" released by "delete_volume" :: held 2.155s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Flow 'volume_create_manager' (4a7d4ee2-a08c-4b00-8cb6-9a7d66ceade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3424b098-0faf-4009-8f43-eecbb0d9818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3424b098-0faf-4009-8f43-eecbb0d9818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1115490990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f7e208-15d0-4e49-8915-ff6a0d6cb2e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13308701a9254dde9ad1c3000e453e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:00Z,use_quota=True,user_id='7be3ffe589014de7866f0c332ea12181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d724eee2-2daa-4218-86d6-f049e017d813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d724eee2-2daa-4218-86d6-f049e017d813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4165a4-cdf8-47dd-b516-11e91e5ebb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4165a4-cdf8-47dd-b516-11e91e5ebb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f7e208-15d0-4e49-8915-ff6a0d6cb2e9', 'volume_name': 'volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ae86cd-5a1c-4927-8c7e-2af4d3e62e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ae86cd-5a1c-4927-8c7e-2af4d3e62e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd39a1f-df54-44c3-9367-70a397d27eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:00 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Volume 68f7e208-15d0-4e49-8915-ff6a0d6cb2e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9', 'volume_size': 1} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1115490990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f7e208-15d0-4e49-8915-ff6a0d6cb2e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13308701a9254dde9ad1c3000e453e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:00Z,use_quota=True,user_id='7be3ffe589014de7866f0c332ea12181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Creating volume 68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:13:00 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:00 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 1073741824 Jul 09 15:13:00 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['e80b8e3d-87f9-41c8-9d57-e84dd03d1be0'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:00 devstack cinder-volume[87042]: WARNING cinder.quota [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1384690761 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1384690761, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Created reservations ['e9fc3fd6-ed1c-4f19-884c-207a40119611', '181b6cea-e3a0-4ffd-972b-ddd11c8ec116', '7df98aef-03b2-4077-ab98-6f4e6ad88b77', '34e34e71-4f76-416b-a757-2672ee331a89'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:00 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:00 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:01 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 1073741824" returned: 0 in 1.003s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:01 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=164,cinder:SELECT=144,cinder:INSERT=51,cinder:DELETE=7 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:13:01 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:01 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=168,cinder:SELECT=153,cinder:DELETE=12,cinder:INSERT=37 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:13:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.777s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:01 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:01 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a4ad313b-c595-4fce-b9c3-1485425374d2 tempest-GroupSnapshotsTest-1555359721 None] Delete group completed successfully. Jul 09 15:13:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:01 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 Jul 09 15:13:01 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:02 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9" returned: 0 in 0.970s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:13:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd39a1f-df54-44c3-9367-70a397d27eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77128ec9-b4b5-4281-940f-f4140871795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:02 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Volume volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 (68f7e208-15d0-4e49-8915-ff6a0d6cb2e9): created successfully Jul 09 15:13:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77128ec9-b4b5-4281-940f-f4140871795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Flow 'volume_create_manager' (4a7d4ee2-a08c-4b00-8cb6-9a7d66ceade8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:02 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c19be4fe-b197-467a-89b9-6dab6ea8e932 tempest-VolumesTestJSON-47256238 None] Created volume successfully. Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Acquiring lock "cinder-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Lock "cinder-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Acquiring lock "cinder-quobyte-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Lock "cinder-quobyte-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb76ac7a-a4ae-4b50-b25e-f06efc4a0592]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:04 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 Jul 09 15:13:04 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:04 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:04 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:05 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9" returned: 0 in 1.111s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:05 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9 Jul 09 15:13:05 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "cinder-a55d32f2-b967-418a-a1ba-8fd721ee0f14-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-a55d32f2-b967-418a-a1ba-8fd721ee0f14-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "cinder-quobyte-a55d32f2-b967-418a-a1ba-8fd721ee0f14" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-quobyte-a55d32f2-b967-418a-a1ba-8fd721ee0f14" acquired by "delete_volume" :: waited 0.075s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a7952-3010-4305-a43e-c918988d231e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:06 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.154s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:13:06 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 Jul 09 15:13:06 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:06 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9" returned: 0 in 0.876s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Lock "cinder-quobyte-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9" released by "delete_volume" :: held 2.033s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Created reservations ['73f27892-088a-49f0-b4fc-b6563c080c3f', '04896bd4-79f8-48a5-b06a-a384df64868b', '4decbf35-35ae-4742-9cc8-1d5e91681d41', 'f1823318-c82d-4f9d-afda-36e5082d5efe'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:06 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:06 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Acquiring lock "cinder-a87ec1bc-2a90-442d-a29d-599b72ed2610-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Lock "cinder-a87ec1bc-2a90-442d-a29d-599b72ed2610-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Acquiring lock "cinder-quobyte-a87ec1bc-2a90-442d-a29d-599b72ed2610" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Lock "cinder-quobyte-a87ec1bc-2a90-442d-a29d-599b72ed2610" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[09844fb9-76ea-4941-8784-5d547b710dd7]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:07 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610 Jul 09 15:13:07 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:07 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14" returned: 0 in 1.242s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:07 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14 Jul 09 15:13:07 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:07 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.986s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:07 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:07 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Deleted volume successfully. Jul 09 15:13:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c96ee96c-84e3-4bc6-ba0f-288597c2a836 tempest-VolumesTestJSON-47256238 None] Lock "cinder-68f7e208-15d0-4e49-8915-ff6a0d6cb2e9-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:08 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610" returned: 0 in 1.147s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:08 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610 Jul 09 15:13:08 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:08 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a55d32f2-b967-418a-a1ba-8fd721ee0f14" returned: 0 in 0.997s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-quobyte-a55d32f2-b967-418a-a1ba-8fd721ee0f14" released by "delete_volume" :: held 2.305s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Created reservations ['612dfb7b-cedf-4cec-a97c-013fec68e606', 'a5238a7f-8f16-434e-a365-c4bcacee1cf0', 'f0694d30-2b5d-49cc-8b25-d73e35dd6b4c', '5c85ba91-a32a-48cf-8b10-e9248c97b65e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:08 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:08 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:08 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a87ec1bc-2a90-442d-a29d-599b72ed2610" returned: 0 in 0.859s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:08 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Lock "cinder-quobyte-a87ec1bc-2a90-442d-a29d-599b72ed2610" released by "delete_volume" :: held 2.069s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Created reservations ['42856c84-75a9-4671-ad04-6d9580f6e1c9', '82112fed-f416-4f13-959d-65d537039642', '7cb0c924-57ea-4dda-bb36-a05b52bdc880', '3fd00631-2492-404b-a479-14dc1de127d9'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:09 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:09 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:09 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.942s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Deleted volume successfully. Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-44a26b41-99bb-4145-821d-2540828a7429 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-a55d32f2-b967-418a-a1ba-8fd721ee0f14-delete_volume" released by "delete_volume" :: held 3.671s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "cinder-fe344b48-9410-43f5-a4fa-63c5ed48d48f-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-fe344b48-9410-43f5-a4fa-63c5ed48d48f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "cinder-quobyte-fe344b48-9410-43f5-a4fa-63c5ed48d48f" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-quobyte-fe344b48-9410-43f5-a4fa-63c5ed48d48f" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7c86f4-435c-4b3e-b5f8-b4590fb41ed6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:09 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f Jul 09 15:13:09 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:10 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.816s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:10 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Deleted volume successfully. Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-374ec021-225b-4700-b0f7-ede4f67147ce tempest-VolumesTestJSON-47256238 None] Lock "cinder-a87ec1bc-2a90-442d-a29d-599b72ed2610-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Acquiring lock "cinder-948a7678-16f9-4c59-b1ed-41bf85aa8847-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Lock "cinder-948a7678-16f9-4c59-b1ed-41bf85aa8847-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Acquiring lock "cinder-quobyte-948a7678-16f9-4c59-b1ed-41bf85aa8847" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Lock "cinder-quobyte-948a7678-16f9-4c59-b1ed-41bf85aa8847" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[563ec4c6-c9da-401d-bda5-eb931b61125c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:10 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847 Jul 09 15:13:10 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:10 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f" returned: 0 in 0.995s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:10 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f Jul 09 15:13:10 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:11 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847" returned: 0 in 1.133s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:11 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe344b48-9410-43f5-a4fa-63c5ed48d48f" returned: 0 in 0.904s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:11 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847 Jul 09 15:13:11 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-quobyte-fe344b48-9410-43f5-a4fa-63c5ed48d48f" released by "delete_volume" :: held 1.959s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Created reservations ['285f22be-fbd2-49cb-b7d6-051b16c50fa0', '0541e4ea-61f6-4d55-baf9-392fed48ee6a', '57aaa081-e256-44ff-bbf1-a113849135f0', '68cba94c-60d7-433b-8638-5ae3b2be4875'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:11 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:11 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "cinder-cbfc38da-bdaa-4468-ac39-ce4c40c473f7-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-cbfc38da-bdaa-4468-ac39-ce4c40c473f7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "cinder-quobyte-cbfc38da-bdaa-4468-ac39-ce4c40c473f7" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-quobyte-cbfc38da-bdaa-4468-ac39-ce4c40c473f7" acquired by "delete_volume" :: waited 0.033s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ede2db-225e-494b-8ceb-3398c309834a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:12 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-948a7678-16f9-4c59-b1ed-41bf85aa8847" returned: 0 in 0.971s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Lock "cinder-quobyte-948a7678-16f9-4c59-b1ed-41bf85aa8847" released by "delete_volume" :: held 2.201s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Created reservations ['d58ffeda-2029-496e-8d12-bb85aa262437', '8ced827d-e4c6-4582-97f3-8b27ada7052b', 'c92f513c-dfdd-47c9-97e0-09c33a4138ef', 'ffc99b10-efc7-4092-857d-5f1733cc2c9a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:12 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 Jul 09 15:13:12 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:12 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:12 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:12 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.214s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:12 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Deleted volume successfully. Jul 09 15:13:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0786cf18-62e3-4e8e-b231-79c4b4337985 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-fe344b48-9410-43f5-a4fa-63c5ed48d48f-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:13 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7" returned: 0 in 1.054s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:13 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7 Jul 09 15:13:13 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:13 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.903s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:13 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:13 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Deleted volume successfully. Jul 09 15:13:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c52024aa-b368-4b44-b5f6-c7402f64d54b tempest-VolumesTestJSON-47256238 None] Lock "cinder-948a7678-16f9-4c59-b1ed-41bf85aa8847-delete_volume" released by "delete_volume" :: held 3.453s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:14 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbfc38da-bdaa-4468-ac39-ce4c40c473f7" returned: 0 in 0.924s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-quobyte-cbfc38da-bdaa-4468-ac39-ce4c40c473f7" released by "delete_volume" :: held 2.051s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:14 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Created reservations ['7c1bdd2c-d489-4cbc-91ad-7bfd924d82ad', 'b26dc95e-ec7a-4d69-b244-ab5f4fb5e899', '75985b47-855b-4135-93b9-4122e96ed7b9', '2898ec50-9c34-4aaa-85e5-c505c131bae6'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:14 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:14 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:15 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.860s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:15 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:15 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Deleted volume successfully. Jul 09 15:13:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1af5d3fd-b8d2-4b3c-86ff-77ce9c0546c5 tempest-AttachVolumeNegativeTest-2087590681 None] Lock "cinder-cbfc38da-bdaa-4468-ac39-ce4c40c473f7-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:15 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-473fba1d-b36e-45cc-b4e9-f8b825340458 tempest-GroupsV320Test-448390837 None] Group tempest-GroupsV320Test-Group-1144878639: creating Jul 09 15:13:15 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-473fba1d-b36e-45cc-b4e9-f8b825340458 tempest-GroupsV320Test-448390837 None] Group tempest-GroupsV320Test-Group-1144878639: created successfully Jul 09 15:13:15 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-473fba1d-b36e-45cc-b4e9-f8b825340458 tempest-GroupsV320Test-448390837 None] Create group completed successfully. Jul 09 15:13:17 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-7a99ed54-db1a-4dda-b22c-8fc554fc11df tempest-GroupsV320Test-448390837 None] Created reservations ['be59b883-0ac8-4443-bbbc-fcfbfbe29a90'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7a99ed54-db1a-4dda-b22c-8fc554fc11df tempest-GroupsV320Test-448390837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7a99ed54-db1a-4dda-b22c-8fc554fc11df tempest-GroupsV320Test-448390837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7a99ed54-db1a-4dda-b22c-8fc554fc11df tempest-GroupsV320Test-448390837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7a99ed54-db1a-4dda-b22c-8fc554fc11df tempest-GroupsV320Test-448390837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7a99ed54-db1a-4dda-b22c-8fc554fc11df tempest-GroupsV320Test-448390837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7a99ed54-db1a-4dda-b22c-8fc554fc11df tempest-GroupsV320Test-448390837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:17 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:17 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:18 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7a99ed54-db1a-4dda-b22c-8fc554fc11df tempest-GroupsV320Test-448390837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.711s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:18 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-7a99ed54-db1a-4dda-b22c-8fc554fc11df tempest-GroupsV320Test-448390837 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:18 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7a99ed54-db1a-4dda-b22c-8fc554fc11df tempest-GroupsV320Test-448390837 None] Delete group completed successfully. Jul 09 15:13:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c6461d9f-bff5-4475-b7a9-d3876e91b4dd tempest-GroupSnapshotsV319Test-2128950772 None] Group tempest-GroupSnapshotsV319Test-Group-1115259091: creating Jul 09 15:13:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c6461d9f-bff5-4475-b7a9-d3876e91b4dd tempest-GroupSnapshotsV319Test-2128950772 None] Group tempest-GroupSnapshotsV319Test-Group-1115259091: created successfully Jul 09 15:13:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c6461d9f-bff5-4475-b7a9-d3876e91b4dd tempest-GroupSnapshotsV319Test-2128950772 None] Create group completed successfully. Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Flow 'volume_create_manager' (fae3122f-15bb-4c39-86bc-409e838e2c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4860ad3e-d3a9-44e2-82e1-ad71e5feabe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4860ad3e-d3a9-44e2-82e1-ad71e5feabe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1542726962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89ef73c0-a91e-4642-95ec-d7b2dde5c55c,host='devstack@QuobyteHD#QuobyteHD',id=22412409-d71b-49a5-be5c-84f5f244b41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad240bd877f42bbbb7405aaddde1381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:24Z,use_quota=True,user_id='dfa773e3729a474d957c77b9fd042932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e51c5dec-f04e-4349-8255-f21c43d65ec8),volume_type_id=e51c5dec-f04e-4349-8255-f21c43d65ec8)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6246740a-39c2-448e-bc3e-e6a8e9a2bad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6246740a-39c2-448e-bc3e-e6a8e9a2bad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adf8390-e8e8-4d6e-ab0a-79ca116d5ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adf8390-e8e8-4d6e-ab0a-79ca116d5ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22412409-d71b-49a5-be5c-84f5f244b41c', 'volume_name': 'volume-22412409-d71b-49a5-be5c-84f5f244b41c', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834b0917-22e1-4417-9303-512e9df3b394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834b0917-22e1-4417-9303-512e9df3b394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc00737f-296c-4340-b52f-b69775dfe435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Volume 22412409-d71b-49a5-be5c-84f5f244b41c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22412409-d71b-49a5-be5c-84f5f244b41c', 'volume_size': 1} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89ef73c0-a91e-4642-95ec-d7b2dde5c55c,created_at=2026-07-09T13:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1542726962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89ef73c0-a91e-4642-95ec-d7b2dde5c55c,host='devstack@QuobyteHD#QuobyteHD',id=22412409-d71b-49a5-be5c-84f5f244b41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad240bd877f42bbbb7405aaddde1381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:24Z,use_quota=True,user_id='dfa773e3729a474d957c77b9fd042932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e51c5dec-f04e-4349-8255-f21c43d65ec8),volume_type_id=e51c5dec-f04e-4349-8255-f21c43d65ec8)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Creating volume 22412409-d71b-49a5-be5c-84f5f244b41c {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:13:23 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:13:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:23 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c 1073741824 Jul 09 15:13:23 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:24 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c 1073741824" returned: 0 in 1.009s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:24 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c Jul 09 15:13:24 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:25 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Flow 'volume_create_manager' (75043cfc-f87d-4fbe-9256-07ccba9f2bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd2242a-4fd9-4d10-af8b-b981511993f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c" returned: 0 in 0.876s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd2242a-4fd9-4d10-af8b-b981511993f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1196152675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a10a316-2c8e-42dc-a127-b18f5b66df82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41c7b6e5e0f4071bbb1ffd58fcd6cc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:26Z,use_quota=True,user_id='2dab22ffacca46b1bba49f7a3781bfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add7aa30-bc1c-4855-b70b-aaeea2c606cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add7aa30-bc1c-4855-b70b-aaeea2c606cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b937f2d8-46cd-4acd-9bf3-d39017c1e592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.image.glance [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Creating Keystone auth plugin from conf {{(pid=87042) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc00737f-296c-4340-b52f-b69775dfe435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22412409-d71b-49a5-be5c-84f5f244b41c', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b65c20-b1be-48f9-ae4d-7e5e2b401009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:25 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Volume volume-22412409-d71b-49a5-be5c-84f5f244b41c (22412409-d71b-49a5-be5c-84f5f244b41c): created successfully Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b65c20-b1be-48f9-ae4d-7e5e2b401009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Flow 'volume_create_manager' (fae3122f-15bb-4c39-86bc-409e838e2c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-dfd3a0e1-801c-464a-a011-a5a6ff4ec676 tempest-GroupSnapshotsV319Test-2128950772 None] Created volume successfully. Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b937f2d8-46cd-4acd-9bf3-d39017c1e592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a10a316-2c8e-42dc-a127-b18f5b66df82', 'volume_name': 'volume-0a10a316-2c8e-42dc-a127-b18f5b66df82', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0179c9b6-b1df-408e-bf7e-a3eb613d9a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0179c9b6-b1df-408e-bf7e-a3eb613d9a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c4cfb8-0781-4cd0-934d-9cb3eb4c3e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:26 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Volume 0a10a316-2c8e-42dc-a127-b18f5b66df82: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a10a316-2c8e-42dc-a127-b18f5b66df82', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Trying to clone 0a10a316-2c8e-42dc-a127-b18f5b66df82 from image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]). {{(pid=87042) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:13:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] GroupSnapshot 2dd63b88-fb9d-412d-8653-cf2a29b80bdc: creating. Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Group snapshot 2dd63b88-fb9d-412d-8653-cf2a29b80bdc: creating. {{(pid=87042) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Creating offline snapshot b328df10-dde5-4bd3-afe2-118a5391aa50 of volume 22412409-d71b-49a5-be5c-84f5f244b41c {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22ac499-c8e6-4e72-a582-0c2c07596454]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:13:26 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Image download 20.69 MB at 20.69 MB/s Jul 09 15:13:26 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c Jul 09 15:13:26 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aeccff-e06e-4c2d-89cc-8ab3a3e96efa]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:27 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD Jul 09 15:13:27 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Flow 'volume_create_manager' (a841cd47-2d8f-41ce-8be7-b6c2a31863e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c0ccf8-9e4f-4e89-87da-f8a79fcc9718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c0ccf8-9e4f-4e89-87da-f8a79fcc9718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1218672374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccf684e-0b75-46d0-950f-e50c2745876f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b37b3dbdb5e94a798e31789a9a986c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:27Z,use_quota=True,user_id='c5c9d966e51a455e86618efc40dbdd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7affa3-dd3d-4700-8e72-ac1019479df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7affa3-dd3d-4700-8e72-ac1019479df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc017c8-6683-49fa-a8e2-f375927e5431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc017c8-6683-49fa-a8e2-f375927e5431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bccf684e-0b75-46d0-950f-e50c2745876f', 'volume_name': 'volume-bccf684e-0b75-46d0-950f-e50c2745876f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119a7c67-876e-4f31-9e3f-4894b6b71af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119a7c67-876e-4f31-9e3f-4894b6b71af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5182b4b5-53f0-4229-96d6-f3cc010e8a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:27 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Volume bccf684e-0b75-46d0-950f-e50c2745876f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bccf684e-0b75-46d0-950f-e50c2745876f', 'volume_size': 1} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:27 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD" returned: 0 in 0.856s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Temporary image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 is fetched for user 2dab22ffacca46b1bba49f7a3781bfd8. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:13:27 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c" returned: 0 in 1.054s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:27 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 1G Jul 09 15:13:27 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed00f2e-f8c4-47f1-8c7d-7c5609383d73]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:28 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD Jul 09 15:13:28 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:28 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD" returned: 0 in 0.816s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:28 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 1G" returned: 0 in 0.980s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22412409-d71b-49a5-be5c-84f5f244b41c -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:28 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22412409-d71b-49a5-be5c-84f5f244b41c -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 Jul 09 15:13:28 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:29 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22412409-d71b-49a5-be5c-84f5f244b41c -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50" returned: 0 in 0.736s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:29 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:13:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:29 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 Jul 09 15:13:29 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:30 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50" returned: 0 in 0.664s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:30 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.info Jul 09 15:13:30 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:30 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.info" returned: 0 in 0.664s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:30 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:13:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:30 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.info Jul 09 15:13:30 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:31 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.info" returned: 0 in 0.676s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.928s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.110s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1218672374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccf684e-0b75-46d0-950f-e50c2745876f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b37b3dbdb5e94a798e31789a9a986c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:27Z,use_quota=True,user_id='c5c9d966e51a455e86618efc40dbdd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Creating volume bccf684e-0b75-46d0-950f-e50c2745876f {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:13:31 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:13:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:31 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f 1073741824 Jul 09 15:13:31 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:31 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9a8349f3-7cb1-4a87-b102-f6ad1c74319b tempest-GroupSnapshotsV319Test-2128950772 None] group_snapshot 2dd63b88-fb9d-412d-8653-cf2a29b80bdc: created successfully Jul 09 15:13:32 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f 1073741824" returned: 0 in 0.894s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] group_snapshot 2dd63b88-fb9d-412d-8653-cf2a29b80bdc: deleting Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] group_snapshot 2dd63b88-fb9d-412d-8653-cf2a29b80bdc: deleting {{(pid=87042) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 15:13:32 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f Jul 09 15:13:32 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Acquiring lock "cinder-quobyte-22412409-d71b-49a5-be5c-84f5f244b41c" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "cinder-quobyte-22412409-d71b-49a5-be5c-84f5f244b41c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Acquiring lock "cinder-quobyte-b328df10-dde5-4bd3-afe2-118a5391aa50" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "cinder-quobyte-b328df10-dde5-4bd3-afe2-118a5391aa50" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Deleting offline snapshot b328df10-dde5-4bd3-afe2-118a5391aa50 of volume 22412409-d71b-49a5-be5c-84f5f244b41c {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] snapshot_file for this snap is: volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b50062-7f02-45b4-a8cd-37969344b28e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:32 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 Jul 09 15:13:32 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:33 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f" returned: 0 in 0.764s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.578s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1196152675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a10a316-2c8e-42dc-a127-b18f5b66df82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41c7b6e5e0f4071bbb1ffd58fcd6cc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:26Z,use_quota=True,user_id='2dab22ffacca46b1bba49f7a3781bfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Creating volume 0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:13:33 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5182b4b5-53f0-4229-96d6-f3cc010e8a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bccf684e-0b75-46d0-950f-e50c2745876f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2989f903-aa42-4b52-8981-6de2637eebf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:33 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 1073741824 Jul 09 15:13:33 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:33 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Volume volume-bccf684e-0b75-46d0-950f-e50c2745876f (bccf684e-0b75-46d0-950f-e50c2745876f): created successfully Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2989f903-aa42-4b52-8981-6de2637eebf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Flow 'volume_create_manager' (a841cd47-2d8f-41ce-8be7-b6c2a31863e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:33 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6fe39a53-5dab-45f9-a597-e7e6ce28a573 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Created volume successfully. Jul 09 15:13:33 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50" returned: 0 in 0.849s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22412409-d71b-49a5-be5c-84f5f244b41c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bc4bdc-cb3c-43d3-bc88-19da9b8401bc]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:33 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c Jul 09 15:13:33 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:34 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 1073741824" returned: 0 in 1.021s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:34 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:13:34 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:34 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c" returned: 0 in 0.930s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:34 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 Jul 09 15:13:34 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:35 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 0 in 0.667s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.951s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Creating offline snapshot 26cdffe6-7807-449a-943d-e2f261389877 of volume bccf684e-0b75-46d0-950f-e50c2745876f {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Attempting download of 20626a8f-3a07-432c-b5dc-bd2614fa7a84 ((None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}])) to volume 0a10a316-2c8e-42dc-a127-b18f5b66df82. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53e16cc-36cc-471b-9121-c27391088a78]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b506b550-07c3-40cd-9c0c-6ffc09011057]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_dbu0slgl {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:35 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f Jul 09 15:13:35 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:35 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_dbu0slgl Jul 09 15:13:35 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:35 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50" returned: 0 in 0.900s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:35 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50 Jul 09 15:13:35 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:36 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f" returned: 0 in 0.980s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:36 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_dbu0slgl" returned: 0 in 0.924s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_dbu0slgl {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:36 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 1G Jul 09 15:13:36 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:36 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c.b328df10-dde5-4bd3-afe2-118a5391aa50" returned: 0 in 0.743s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "cinder-quobyte-b328df10-dde5-4bd3-afe2-118a5391aa50" released by "_delete_snapshot" :: held 3.571s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "cinder-quobyte-22412409-d71b-49a5-be5c-84f5f244b41c" released by "delete_snapshot" :: held 3.599s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:36 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_dbu0slgl Jul 09 15:13:36 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:36 devstack cinder-volume[87042]: WARNING cinder.quota [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1682115664 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1682115664, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:13:36 devstack cinder-volume[87042]: WARNING cinder.quota [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1682115664 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1682115664, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:13:36 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] Created reservations ['6f6ece3f-f98f-46e5-99b2-d58fdc3608be', '21446a02-cd00-4c45-b505-1439ddd9a0b5', '39ab3e67-8447-4c4d-897a-30c32f41c507', '547ae0b2-5a4a-4c04-b01a-edd166f854ac'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0c472d57-fbf3-4d39-8706-4c337d170374 tempest-GroupSnapshotsV319Test-2128950772 None] group_snapshot 2dd63b88-fb9d-412d-8653-cf2a29b80bdc: deleted successfully Jul 09 15:13:37 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_dbu0slgl" returned: 1 in 0.856s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_dbu0slgl' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa096e8c-d876-4bb5-83d9-4ce511621e43]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:37 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 1G" returned: 0 in 1.010s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bccf684e-0b75-46d0-950f-e50c2745876f -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:37 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD Jul 09 15:13:37 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:37 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bccf684e-0b75-46d0-950f-e50c2745876f -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 Jul 09 15:13:37 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Acquiring lock "cinder-quobyte-22412409-d71b-49a5-be5c-84f5f244b41c" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "cinder-quobyte-22412409-d71b-49a5-be5c-84f5f244b41c" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bbf2a0-3ead-43a9-8851-862d8d3b33f6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:37 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c Jul 09 15:13:37 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:37 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD" returned: 0 in 0.845s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] 20626a8f-3a07-432c-b5dc-bd2614fa7a84 was qcow2, converting to raw {{(pid=87042) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:37 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:13:37 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:37 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bccf684e-0b75-46d0-950f-e50c2745876f -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877" returned: 0 in 0.834s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:37 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 is being set with open permissions: ugo+rw Jul 09 15:13:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:38 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 Jul 09 15:13:38 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:38 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c" returned: 0 in 0.967s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:38 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c Jul 09 15:13:38 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:38 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877" returned: 0 in 0.784s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:38 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.info Jul 09 15:13:38 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:39 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-22412409-d71b-49a5-be5c-84f5f244b41c" returned: 0 in 0.809s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "cinder-quobyte-22412409-d71b-49a5-be5c-84f5f244b41c" released by "delete_volume" :: held 1.878s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Created reservations ['b10df0ba-793f-4dff-a56a-077c7b9d81da'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:39 devstack cinder-volume[87042]: WARNING cinder.quota [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1682115664 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1682115664, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Created reservations ['dcfa5a31-f547-4977-b58c-7d3d0b00fb48', 'b4ee71b7-8eb5-422d-b3a2-79c55ea0dc21', '3d59bb78-63d6-460a-80f9-3a91598d7a99', '281cddbc-e7cc-4392-b187-4ad38aedb6f5'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:39 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:39 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:39 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.info" returned: 0 in 0.819s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:39 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.info is being set with open permissions: ugo+rw Jul 09 15:13:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:39 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.info Jul 09 15:13:39 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:40 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 0 in 2.538s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:40 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_b43m6l4adevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:13:40 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Converted 112.00 MB image at 44.10 MB/s Jul 09 15:13:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:40 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 1G Jul 09 15:13:40 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:40 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.info" returned: 0 in 0.841s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:40 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.414s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.034s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:40 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:40 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-995cfbf2-b8fe-495c-a200-de5f75075284 tempest-GroupSnapshotsV319Test-2128950772 None] Delete group completed successfully. Jul 09 15:13:40 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-327944ba-82bf-465f-a94f-5330e06a87df tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Create snapshot completed successfully Jul 09 15:13:41 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 1G" returned: 0 in 0.739s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:41 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[570d1fcc-5368-41f8-9393-a4487cc71959]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:41 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:13:41 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Acquiring lock "cinder-26cdffe6-7807-449a-943d-e2f261389877-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "cinder-26cdffe6-7807-449a-943d-e2f261389877-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Acquiring lock "cinder-quobyte-bccf684e-0b75-46d0-950f-e50c2745876f" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "cinder-quobyte-bccf684e-0b75-46d0-950f-e50c2745876f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Acquiring lock "cinder-quobyte-26cdffe6-7807-449a-943d-e2f261389877" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "cinder-quobyte-26cdffe6-7807-449a-943d-e2f261389877" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Deleting offline snapshot 26cdffe6-7807-449a-943d-e2f261389877 of volume bccf684e-0b75-46d0-950f-e50c2745876f {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] snapshot_file for this snap is: volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[01637bdd-d765-4557-ae9f-cc835c7191be]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:42 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 0 in 1.047s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:42 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 Jul 09 15:13:42 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:42 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:13:42 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:43 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877" returned: 0 in 0.869s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bccf684e-0b75-46d0-950f-e50c2745876f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:43 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 1 in 0.868s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Downloaded image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 ((None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}])) to volume 0a10a316-2c8e-42dc-a127-b18f5b66df82 successfully. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Temporary image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 for user 2dab22ffacca46b1bba49f7a3781bfd8 is deleted. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Marking volume 0a10a316-2c8e-42dc-a127-b18f5b66df82 as bootable. {{(pid=87042) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7725294-9396-40b2-af2c-24ec7a2c08b3]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Copying metadata from image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 to 0a10a316-2c8e-42dc-a127-b18f5b66df82. {{(pid=87042) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Creating volume glance metadata for volume 0a10a316-2c8e-42dc-a127-b18f5b66df82 backed by image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87042) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c4cfb8-0781-4cd0-934d-9cb3eb4c3e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a10a316-2c8e-42dc-a127-b18f5b66df82', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0111aeee-d27e-45e4-a4a3-12668c11bbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:43 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Volume volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 (0a10a316-2c8e-42dc-a127-b18f5b66df82): created successfully Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0111aeee-d27e-45e4-a4a3-12668c11bbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Flow 'volume_create_manager' (75043cfc-f87d-4fbe-9256-07ccba9f2bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:43 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f Jul 09 15:13:43 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:43 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-965e7ab2-1c08-4e45-ab4b-bd601313df7f tempest-TestShelveInstance-2000558034 None] Created volume successfully. Jul 09 15:13:43 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f" returned: 0 in 0.840s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:44 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 Jul 09 15:13:44 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:45 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877" returned: 0 in 1.071s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:45 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877 Jul 09 15:13:45 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-729e468c-92a8-4746-bf4a-bd16e3e953b0 tempest-GroupsTest-1901764821 None] Group tempest-Group1-1946978766: creating Jul 09 15:13:45 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-729e468c-92a8-4746-bf4a-bd16e3e953b0 tempest-GroupsTest-1901764821 None] Group tempest-Group1-1946978766: created successfully Jul 09 15:13:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f.26cdffe6-7807-449a-943d-e2f261389877" returned: 0 in 0.910s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-729e468c-92a8-4746-bf4a-bd16e3e953b0 tempest-GroupsTest-1901764821 None] Create group completed successfully. Jul 09 15:13:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "cinder-quobyte-26cdffe6-7807-449a-943d-e2f261389877" released by "_delete_snapshot" :: held 3.881s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "cinder-quobyte-bccf684e-0b75-46d0-950f-e50c2745876f" released by "delete_snapshot" :: held 3.917s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:46 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Created reservations ['88c17278-6763-48f3-a886-a85210fda7a7', 'cf4c36bf-14a3-4caf-8c33-954f1053d989', 'c1639512-62c3-496b-8441-7f6405d34610', 'acd7a4cf-b0c4-465a-a039-8217759f5bdd'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:46 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Delete snapshot completed successfully. Jul 09 15:13:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451608f3-3882-49e6-a9f0-7dc822d05b3f tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "cinder-26cdffe6-7807-449a-943d-e2f261389877-delete_snapshot" released by "delete_snapshot" :: held 4.106s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Acquiring lock "cinder-bccf684e-0b75-46d0-950f-e50c2745876f-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "cinder-bccf684e-0b75-46d0-950f-e50c2745876f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Acquiring lock "cinder-quobyte-bccf684e-0b75-46d0-950f-e50c2745876f" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "cinder-quobyte-bccf684e-0b75-46d0-950f-e50c2745876f" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b093204e-d49d-41ec-9973-83f6d406524f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:46 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f Jul 09 15:13:46 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:47 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-11ae926b-f330-4225-a843-33b1c5324b49 tempest-GroupsTest-1901764821 None] Group tempest-Group2-682232286: creating Jul 09 15:13:47 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-11ae926b-f330-4225-a843-33b1c5324b49 tempest-GroupsTest-1901764821 None] Group tempest-Group2-682232286: created successfully Jul 09 15:13:47 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-11ae926b-f330-4225-a843-33b1c5324b49 tempest-GroupsTest-1901764821 None] Create group completed successfully. Jul 09 15:13:47 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f" returned: 0 in 0.847s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:47 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f Jul 09 15:13:47 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:48 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bccf684e-0b75-46d0-950f-e50c2745876f" returned: 0 in 0.671s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "cinder-quobyte-bccf684e-0b75-46d0-950f-e50c2745876f" released by "delete_volume" :: held 1.575s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:48 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Created reservations ['b8f212ab-2455-49e8-9020-026da0d5dc59', 'e7cef385-b13b-4202-bca8-f83015db2cd4', 'b43e06ac-eda5-4933-a782-021613942199', 'c1d95478-07e1-4f2b-8e15-f3f14178474d'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:48 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:48 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:49 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.798s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:49 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Deleted volume successfully. Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Flow 'volume_create_manager' (5f48ac8b-de36-45dd-be52-c2c34e669c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c794c3e8-9278-4c63-aa73-9ed6100ae5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-babdb343-ade1-4794-8c37-239638ac59a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-574314933 None] Lock "cinder-bccf684e-0b75-46d0-950f-e50c2745876f-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c794c3e8-9278-4c63-aa73-9ed6100ae5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368100714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27099110-b7b6-40d5-8b55-530de9d46590,host='devstack@QuobyteHD#QuobyteHD',id=0589deb9-9861-4072-8b27-23a5303a8358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2489aba105b84a608cc47ce01ec0e285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:49Z,use_quota=True,user_id='672d7624fd4e4aafac0d017738cb66b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(820f7a26-535b-4bec-a7fc-5f6b7975676a),volume_type_id=820f7a26-535b-4bec-a7fc-5f6b7975676a)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e41b12e5-160a-4548-8385-f0eb71c037e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e41b12e5-160a-4548-8385-f0eb71c037e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a90904-fd02-4636-bca6-8fc1d252dd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a90904-fd02-4636-bca6-8fc1d252dd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0589deb9-9861-4072-8b27-23a5303a8358', 'volume_name': 'volume-0589deb9-9861-4072-8b27-23a5303a8358', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c16923a-526b-48a4-9ae2-f55ffe971ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c16923a-526b-48a4-9ae2-f55ffe971ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c2e55a-bcef-4bea-bd83-b0af39cd0130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:49 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Volume 0589deb9-9861-4072-8b27-23a5303a8358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0589deb9-9861-4072-8b27-23a5303a8358', 'volume_size': 1} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=27099110-b7b6-40d5-8b55-530de9d46590,created_at=2026-07-09T13:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368100714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27099110-b7b6-40d5-8b55-530de9d46590,host='devstack@QuobyteHD#QuobyteHD',id=0589deb9-9861-4072-8b27-23a5303a8358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2489aba105b84a608cc47ce01ec0e285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:49Z,use_quota=True,user_id='672d7624fd4e4aafac0d017738cb66b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(820f7a26-535b-4bec-a7fc-5f6b7975676a),volume_type_id=820f7a26-535b-4bec-a7fc-5f6b7975676a)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Creating volume 0589deb9-9861-4072-8b27-23a5303a8358 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:13:49 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:13:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:49 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358 1073741824 Jul 09 15:13:49 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:50 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358 1073741824" returned: 0 in 1.076s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:50 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358 Jul 09 15:13:50 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:51 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358" returned: 0 in 0.761s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:13:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c2e55a-bcef-4bea-bd83-b0af39cd0130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0589deb9-9861-4072-8b27-23a5303a8358', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d65a541c-b4a0-4a88-83db-04b6ad22fd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:51 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Volume volume-0589deb9-9861-4072-8b27-23a5303a8358 (0589deb9-9861-4072-8b27-23a5303a8358): created successfully Jul 09 15:13:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d65a541c-b4a0-4a88-83db-04b6ad22fd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Flow 'volume_create_manager' (5f48ac8b-de36-45dd-be52-c2c34e669c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:51 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2c1ac324-efdc-470c-90c2-5120bbf1d248 tempest-GroupsTest-1901764821 None] Created volume successfully. Jul 09 15:13:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-cf3367ca-385a-4580-8bc0-48c75608f973 req-f425947e-60ae-478f-81c8-33dc064de822 tempest-TestShelveInstance-2000558034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-cf3367ca-385a-4580-8bc0-48c75608f973 req-f425947e-60ae-478f-81c8-33dc064de822 tempest-TestShelveInstance-2000558034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:52 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9deb857-ed97-4926-9c16-ebf484cd66e4]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-cf3367ca-385a-4580-8bc0-48c75608f973 req-f425947e-60ae-478f-81c8-33dc064de822 tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:52 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:13:52 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Acquiring lock "cinder-quobyte-0589deb9-9861-4072-8b27-23a5303a8358" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Lock "cinder-quobyte-0589deb9-9861-4072-8b27-23a5303a8358" acquired by "delete_volume" :: waited 0.040s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:52 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[511b16f0-03ea-4ef3-8280-646fced5b979]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:52 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358 Jul 09 15:13:52 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:53 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-cf3367ca-385a-4580-8bc0-48c75608f973 req-f425947e-60ae-478f-81c8-33dc064de822 tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 0 in 1.134s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-cf3367ca-385a-4580-8bc0-48c75608f973 req-f425947e-60ae-478f-81c8-33dc064de822 tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:53 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:13:53 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:53 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358" returned: 0 in 1.044s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:53 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358 Jul 09 15:13:53 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:54 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-cf3367ca-385a-4580-8bc0-48c75608f973 req-f425947e-60ae-478f-81c8-33dc064de822 tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 1 in 0.995s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-cf3367ca-385a-4580-8bc0-48c75608f973 req-f425947e-60ae-478f-81c8-33dc064de822 tempest-TestShelveInstance-2000558034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-cf3367ca-385a-4580-8bc0-48c75608f973 req-f425947e-60ae-478f-81c8-33dc064de822 tempest-TestShelveInstance-2000558034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.210s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-cf3367ca-385a-4580-8bc0-48c75608f973 req-f425947e-60ae-478f-81c8-33dc064de822 tempest-TestShelveInstance-2000558034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-0a10a316-2c8e-42dc-a127-b18f5b66df82', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37d0c043-43d0-4585-a31f-ddfbd04f7e1f', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:13:54 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-cf3367ca-385a-4580-8bc0-48c75608f973 req-f425947e-60ae-478f-81c8-33dc064de822 tempest-TestShelveInstance-2000558034 None] attachment_update completed successfully. Jul 09 15:13:54 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0589deb9-9861-4072-8b27-23a5303a8358" returned: 0 in 0.944s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Lock "cinder-quobyte-0589deb9-9861-4072-8b27-23a5303a8358" released by "delete_volume" :: held 2.093s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Created reservations ['f9dd51b8-0d81-4147-b8f1-98e23de4973a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:54 devstack cinder-volume[87042]: WARNING cinder.quota [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-734410037 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-734410037, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:13:54 devstack cinder-volume[87042]: WARNING cinder.quota [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-734410037 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-734410037, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Created reservations ['c0a93580-d5a6-47e9-a6b4-1b99f3a168f3', '72db4076-a657-4120-93ed-d9886dee0000', 'c8395a9e-72c7-4b1e-97f8-96b2c716c98e', '110e7b18-8136-454e-b823-5556669be35d'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:54 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:54 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:55 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-b97f7e5a-17c3-457e-b07a-4e906e224e18 tempest-GroupsTest-1901764821 None] Created reservations ['69150a48-d781-4148-9728-cb81df1a556d'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b97f7e5a-17c3-457e-b07a-4e906e224e18 tempest-GroupsTest-1901764821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b97f7e5a-17c3-457e-b07a-4e906e224e18 tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b97f7e5a-17c3-457e-b07a-4e906e224e18 tempest-GroupsTest-1901764821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b97f7e5a-17c3-457e-b07a-4e906e224e18 tempest-GroupsTest-1901764821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b97f7e5a-17c3-457e-b07a-4e906e224e18 tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b97f7e5a-17c3-457e-b07a-4e906e224e18 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:55 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:13:55 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:55 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.815s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:55 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-77e27240-85d5-463a-bb3a-6448af3ce57c tempest-GroupsTest-1901764821 None] Delete group completed successfully. Jul 09 15:13:56 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b97f7e5a-17c3-457e-b07a-4e906e224e18 tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.824s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:56 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b97f7e5a-17c3-457e-b07a-4e906e224e18 tempest-GroupsTest-1901764821 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:56 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b97f7e5a-17c3-457e-b07a-4e906e224e18 tempest-GroupsTest-1901764821 None] Delete group completed successfully. Jul 09 15:13:56 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-4638283d-4ffc-462f-bdac-b59cba772363 tempest-GroupsTest-1901764821 None] Group tempest-GroupsTest-Group-918787910: creating Jul 09 15:13:56 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-4638283d-4ffc-462f-bdac-b59cba772363 tempest-GroupsTest-1901764821 None] Group tempest-GroupsTest-Group-918787910: created successfully Jul 09 15:13:56 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-4638283d-4ffc-462f-bdac-b59cba772363 tempest-GroupsTest-1901764821 None] Create group completed successfully. Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Flow 'volume_create_manager' (f8dcb574-911a-465c-b6ba-b81d32dcd71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ce17ec-f4e7-45e5-b129-767dbe56408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ce17ec-f4e7-45e5-b129-767dbe56408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1354507027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2912d75-7534-45ae-a88e-b31b37d9138f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b274e157a844e16a0f2a0e73b56ea0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:58Z,use_quota=True,user_id='69b592340e2d41de8b71dc39264ba21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee9d3a85-280b-4f3c-961b-3531db5c60c6),volume_type_id=ee9d3a85-280b-4f3c-961b-3531db5c60c6)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b87c5ea-c2fa-47c3-a115-db397e78ca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b87c5ea-c2fa-47c3-a115-db397e78ca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f471f4-a386-409f-8e2a-976e2e3e8617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f471f4-a386-409f-8e2a-976e2e3e8617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2912d75-7534-45ae-a88e-b31b37d9138f', 'volume_name': 'volume-c2912d75-7534-45ae-a88e-b31b37d9138f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2b85a9-c7e6-4df6-b3d4-c9a3c605abab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2b85a9-c7e6-4df6-b3d4-c9a3c605abab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76460ab7-6723-4a6f-a7ec-31d18b121c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:58 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Volume c2912d75-7534-45ae-a88e-b31b37d9138f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2912d75-7534-45ae-a88e-b31b37d9138f', 'volume_size': 1} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1354507027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2912d75-7534-45ae-a88e-b31b37d9138f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b274e157a844e16a0f2a0e73b56ea0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:58Z,use_quota=True,user_id='69b592340e2d41de8b71dc39264ba21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee9d3a85-280b-4f3c-961b-3531db5c60c6),volume_type_id=ee9d3a85-280b-4f3c-961b-3531db5c60c6)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Creating volume c2912d75-7534-45ae-a88e-b31b37d9138f {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:13:58 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:58 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f 1073741824 Jul 09 15:13:58 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Flow 'volume_create_manager' (884628ba-e8e2-402a-b27f-9930b1d48d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8817d7-a952-4c56-800f-1206888b94ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8817d7-a952-4c56-800f-1206888b94ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233356163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a349bd9-85c4-4ab4-b40a-37d4ca41b145,host='devstack@QuobyteHD#QuobyteHD',id=babc2b36-98b3-4beb-9c80-9024f21c8532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2489aba105b84a608cc47ce01ec0e285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:59Z,use_quota=True,user_id='672d7624fd4e4aafac0d017738cb66b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bcca0cb-8a88-437b-a7d8-f9493d3bb387),volume_type_id=2bcca0cb-8a88-437b-a7d8-f9493d3bb387)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864f4f3f-0cd6-41a8-bd5d-ea7464fdcd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864f4f3f-0cd6-41a8-bd5d-ea7464fdcd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91be3010-4076-4fd5-850c-e41eba63d324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91be3010-4076-4fd5-850c-e41eba63d324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babc2b36-98b3-4beb-9c80-9024f21c8532', 'volume_name': 'volume-babc2b36-98b3-4beb-9c80-9024f21c8532', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c88bd94-fb4f-4f26-92ee-f4b0978e029f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c88bd94-fb4f-4f26-92ee-f4b0978e029f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3edecf3-2dd4-404b-bda7-83f69c799c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:59 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Volume babc2b36-98b3-4beb-9c80-9024f21c8532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babc2b36-98b3-4beb-9c80-9024f21c8532', 'volume_size': 1} Jul 09 15:13:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:59 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f 1073741824" returned: 0 in 1.223s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:00 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f Jul 09 15:14:00 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:00 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f" returned: 0 in 0.852s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.808s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a349bd9-85c4-4ab4-b40a-37d4ca41b145,created_at=2026-07-09T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233356163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a349bd9-85c4-4ab4-b40a-37d4ca41b145,host='devstack@QuobyteHD#QuobyteHD',id=babc2b36-98b3-4beb-9c80-9024f21c8532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2489aba105b84a608cc47ce01ec0e285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:59Z,use_quota=True,user_id='672d7624fd4e4aafac0d017738cb66b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bcca0cb-8a88-437b-a7d8-f9493d3bb387),volume_type_id=2bcca0cb-8a88-437b-a7d8-f9493d3bb387)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Creating volume babc2b36-98b3-4beb-9c80-9024f21c8532 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:00 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76460ab7-6723-4a6f-a7ec-31d18b121c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2912d75-7534-45ae-a88e-b31b37d9138f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:00 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532 1073741824 Jul 09 15:14:00 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5270b33-14b0-4722-8b7d-e5776c44f6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:00 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Volume volume-c2912d75-7534-45ae-a88e-b31b37d9138f (c2912d75-7534-45ae-a88e-b31b37d9138f): created successfully Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5270b33-14b0-4722-8b7d-e5776c44f6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Flow 'volume_create_manager' (f8dcb574-911a-465c-b6ba-b81d32dcd71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:00 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e4885c17-4b48-464e-ae50-6a68cbf4f924 tempest-VolumeTypesAccessTest-1423316258 None] Created volume successfully. Jul 09 15:14:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Acquiring lock "cinder-c2912d75-7534-45ae-a88e-b31b37d9138f-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Lock "cinder-c2912d75-7534-45ae-a88e-b31b37d9138f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:01 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=113,cinder:INSERT=31,cinder:UPDATE=135,cinder:DELETE=5 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:14:01 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=113,cinder:SELECT=120,cinder:INSERT=38,cinder:DELETE=9 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:14:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Acquiring lock "cinder-quobyte-c2912d75-7534-45ae-a88e-b31b37d9138f" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Lock "cinder-quobyte-c2912d75-7534-45ae-a88e-b31b37d9138f" acquired by "delete_volume" :: waited 0.037s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:02 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f02ac70-8d0f-4052-afc5-75eb26eb4982]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:02 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f Jul 09 15:14:02 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:02 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532 1073741824" returned: 0 in 1.498s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:02 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532 Jul 09 15:14:02 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:03 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f" returned: 0 in 1.305s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:03 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f Jul 09 15:14:03 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:03 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532" returned: 0 in 1.304s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] <== create_volume: return (2928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.932s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3edecf3-2dd4-404b-bda7-83f69c799c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babc2b36-98b3-4beb-9c80-9024f21c8532', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd3dfe3-7ce5-492b-9211-b2e1ad5bc888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:03 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Volume volume-babc2b36-98b3-4beb-9c80-9024f21c8532 (babc2b36-98b3-4beb-9c80-9024f21c8532): created successfully Jul 09 15:14:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd3dfe3-7ce5-492b-9211-b2e1ad5bc888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Flow 'volume_create_manager' (884628ba-e8e2-402a-b27f-9930b1d48d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:03 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-650c25f1-a4e2-456e-a025-fdb74ea01ec3 tempest-GroupsTest-1901764821 None] Created volume successfully. Jul 09 15:14:04 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c2912d75-7534-45ae-a88e-b31b37d9138f" returned: 0 in 0.896s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Lock "cinder-quobyte-c2912d75-7534-45ae-a88e-b31b37d9138f" released by "delete_volume" :: held 2.287s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:04 devstack cinder-volume[87042]: WARNING cinder.quota [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1555476465 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1555476465, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:14:04 devstack cinder-volume[87042]: WARNING cinder.quota [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1555476465 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1555476465, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Created reservations ['f0a923a2-d68c-4b8d-903f-5a08de29563f', 'a65e5499-2961-40db-893c-68a31f16e353', '7c35c5e2-5b78-4058-8d2a-c1ec28aff27b', '04a6f3ad-a3aa-45d7-b49a-49c5ac1db5c6'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:04 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:14:04 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:05 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:14:05 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Flow 'volume_create_manager' (f7216eb7-a93a-44ee-a92a-0e3e1a36d761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58993ced-48bc-4b00-ba28-4f768ceef58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58993ced-48bc-4b00-ba28-4f768ceef58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259441244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a349bd9-85c4-4ab4-b40a-37d4ca41b145,host='devstack@QuobyteHD#QuobyteHD',id=00fe6cd5-791e-4139-902a-29e79a66ef91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2489aba105b84a608cc47ce01ec0e285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:05Z,use_quota=True,user_id='672d7624fd4e4aafac0d017738cb66b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bcca0cb-8a88-437b-a7d8-f9493d3bb387),volume_type_id=2bcca0cb-8a88-437b-a7d8-f9493d3bb387)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f391a09a-109e-4819-942f-b7dbbe93401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f391a09a-109e-4819-942f-b7dbbe93401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf677873-f3ca-41d9-881d-22693734e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf677873-f3ca-41d9-881d-22693734e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00fe6cd5-791e-4139-902a-29e79a66ef91', 'volume_name': 'volume-00fe6cd5-791e-4139-902a-29e79a66ef91', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce81dd8e-7420-4b8f-953e-323141fc78a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce81dd8e-7420-4b8f-953e-323141fc78a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205d9085-0021-4847-bd1f-316042ed223b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:05 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Volume 00fe6cd5-791e-4139-902a-29e79a66ef91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00fe6cd5-791e-4139-902a-29e79a66ef91', 'volume_size': 1} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a349bd9-85c4-4ab4-b40a-37d4ca41b145,created_at=2026-07-09T13:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259441244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a349bd9-85c4-4ab4-b40a-37d4ca41b145,host='devstack@QuobyteHD#QuobyteHD',id=00fe6cd5-791e-4139-902a-29e79a66ef91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2489aba105b84a608cc47ce01ec0e285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:05Z,use_quota=True,user_id='672d7624fd4e4aafac0d017738cb66b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bcca0cb-8a88-437b-a7d8-f9493d3bb387),volume_type_id=2bcca0cb-8a88-437b-a7d8-f9493d3bb387)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Creating volume 00fe6cd5-791e-4139-902a-29e79a66ef91 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:05 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:14:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:05 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91 1073741824 Jul 09 15:14:05 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:06 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 2.030s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:06 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:06 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Deleted volume successfully. Jul 09 15:14:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8f9fe8f4-0919-4cf0-8f28-c8b4cbd07f88 tempest-VolumeTypesAccessTest-1423316258 None] Lock "cinder-c2912d75-7534-45ae-a88e-b31b37d9138f-delete_volume" released by "delete_volume" :: held 4.881s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:06 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.913s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:06 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:06 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:14:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:14:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:14:07 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91 1073741824" returned: 0 in 2.083s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:07 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91 Jul 09 15:14:07 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:09 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91" returned: 0 in 1.184s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] <== create_volume: return (3361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.364s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205d9085-0021-4847-bd1f-316042ed223b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00fe6cd5-791e-4139-902a-29e79a66ef91', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6563f3f-6ae5-4fb2-a7c7-f79edd492c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:09 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Volume volume-00fe6cd5-791e-4139-902a-29e79a66ef91 (00fe6cd5-791e-4139-902a-29e79a66ef91): created successfully Jul 09 15:14:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6563f3f-6ae5-4fb2-a7c7-f79edd492c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Flow 'volume_create_manager' (f7216eb7-a93a-44ee-a92a-0e3e1a36d761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-87c79e52-90c3-4197-ad99-6ea167276bd5 tempest-GroupsTest-1901764821 None] Created volume successfully. Jul 09 15:14:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f1f768fc-e718-4d7a-a216-7d57940fa092 tempest-GroupsTest-1901764821 None] Update group completed successfully. Jul 09 15:14:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-67ee2a90-047a-4ef7-b12c-53558e04f0b1 tempest-GroupsTest-1901764821 None] Update group completed successfully. Jul 09 15:14:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Acquiring lock "cinder-quobyte-00fe6cd5-791e-4139-902a-29e79a66ef91" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Lock "cinder-quobyte-00fe6cd5-791e-4139-902a-29e79a66ef91" acquired by "delete_volume" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:13 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6376d69-a5fb-4e9e-b5ca-0f7c4651a00e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:13 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91 Jul 09 15:14:13 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:14 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91" returned: 0 in 1.122s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:14 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91 Jul 09 15:14:14 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Flow 'volume_create_manager' (e09e066d-09bb-4d75-8440-233ef6144969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20945d63-39f3-42ab-abeb-e54549c86377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20945d63-39f3-42ab-abeb-e54549c86377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-524544797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd97b00a74d48508ed0a817aa36e47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:15Z,use_quota=True,user_id='468020ad0a274015b23b2b7f7c42c778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a277cb03-61f6-48dd-a642-d867758e7288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a277cb03-61f6-48dd-a642-d867758e7288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a909c1c7-c3b3-43fc-b1f8-08863af741c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a909c1c7-c3b3-43fc-b1f8-08863af741c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126', 'volume_name': 'volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4a0378-5c8a-4770-a84f-6279affa5575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4a0378-5c8a-4770-a84f-6279affa5575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19385fa-32f8-48f1-996a-db1f92731d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:14 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Volume 74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126', 'volume_size': 1} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-524544797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd97b00a74d48508ed0a817aa36e47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:15Z,use_quota=True,user_id='468020ad0a274015b23b2b7f7c42c778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Creating volume 74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:14 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:14:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:14 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 1073741824 Jul 09 15:14:14 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:15 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-00fe6cd5-791e-4139-902a-29e79a66ef91" returned: 0 in 0.811s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Lock "cinder-quobyte-00fe6cd5-791e-4139-902a-29e79a66ef91" released by "delete_volume" :: held 1.997s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Acquiring lock "cinder-quobyte-babc2b36-98b3-4beb-9c80-9024f21c8532" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Lock "cinder-quobyte-babc2b36-98b3-4beb-9c80-9024f21c8532" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:15 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e969e1b-25da-4001-a779-8dd13b91d893]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:15 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532 Jul 09 15:14:15 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:16 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 1073741824" returned: 0 in 1.249s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:16 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 Jul 09 15:14:16 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:16 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532" returned: 0 in 1.083s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:16 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532 Jul 09 15:14:16 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:16 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" returned: 0 in 0.887s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19385fa-32f8-48f1-996a-db1f92731d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9bee262-fa97-4b07-a130-494e96f84723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:17 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Volume volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 (74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126): created successfully Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9bee262-fa97-4b07-a130-494e96f84723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Flow 'volume_create_manager' (e09e066d-09bb-4d75-8440-233ef6144969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:17 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f364b82c-81b6-4453-8340-0f88f5f4d38a tempest-SnapshotMetadataTestJSON-2102231693 None] Created volume successfully. Jul 09 15:14:17 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-babc2b36-98b3-4beb-9c80-9024f21c8532" returned: 0 in 0.927s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Lock "cinder-quobyte-babc2b36-98b3-4beb-9c80-9024f21c8532" released by "delete_volume" :: held 2.055s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Created reservations ['400d1208-38e3-406a-ad38-286b04928fa9'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:17 devstack cinder-volume[87042]: WARNING cinder.quota [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-772791419 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-772791419, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:14:17 devstack cinder-volume[87042]: WARNING cinder.quota [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-772791419 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-772791419, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Created reservations ['46cfb7ab-a3b7-453d-94aa-e0a0726e38f8', 'ebcf45c8-0b07-4bf0-bb31-5042531e0a46', 'c1067f7b-0377-448a-bcf8-4588ec6bbed3', '0f1d2de1-a00e-4be7-a20f-97935c896eb0'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Created reservations ['d80d5ee8-33d9-4827-86b6-0398293c6a10', '00d443e6-fa2b-4c3a-b192-99acd047db0e', '0e3d2e81-c956-40ef-855c-2de51748386d', 'eb336d98-a6f8-48d4-b1ca-73943d5c08b9'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:17 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:14:17 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Creating offline snapshot 8f8772ba-697e-41b5-968f-8a63ede36e8a of volume 74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:14:18 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d98925-c428-4fee-a398-81a2384652d9]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:18 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 Jul 09 15:14:18 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:18 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.101s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:18 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:18 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-48b30e0a-b722-4dce-9c7e-556c69c50555 tempest-GroupsTest-1901764821 None] Delete group completed successfully. Jul 09 15:14:19 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" returned: 0 in 1.065s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:19 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a 1G Jul 09 15:14:19 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:20 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a 1G" returned: 0 in 0.981s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:20 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a Jul 09 15:14:20 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:21 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a" returned: 0 in 0.754s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:21 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a is being set with open permissions: ugo+rw Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:21 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a Jul 09 15:14:21 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Flow 'volume_create_manager' (d94064a7-c65a-4b4b-b9ab-84ef623ed99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb52c36a-bca9-4f9c-8260-5a66b9b32608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb52c36a-bca9-4f9c-8260-5a66b9b32608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1235975815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1daaa82b-337e-45e9-b640-83e2de309780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53e662aacd54c91b899124b91b8a05d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:21Z,use_quota=True,user_id='05daa3d3cbe94ed6bad6e6c38c3b3645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07489504-fd76-4632-8646-89fb6557f42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07489504-fd76-4632-8646-89fb6557f42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8fa214-45bf-4124-97f2-1d31b6bb830f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.image.glance [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Creating Keystone auth plugin from conf {{(pid=87042) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:14:21 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a" returned: 0 in 0.694s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:21 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.info Jul 09 15:14:21 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8fa214-45bf-4124-97f2-1d31b6bb830f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1daaa82b-337e-45e9-b640-83e2de309780', 'volume_name': 'volume-1daaa82b-337e-45e9-b640-83e2de309780', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6ca82b-3c2d-4115-b66a-9db07b60a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6ca82b-3c2d-4115-b66a-9db07b60a411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3eb837-b4e5-45b9-92fd-0012540f31b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Volume 1daaa82b-337e-45e9-b640-83e2de309780: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1daaa82b-337e-45e9-b640-83e2de309780', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 15:14:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Trying to clone 1daaa82b-337e-45e9-b640-83e2de309780 from image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]). {{(pid=87042) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:14:22 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:14:22 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Image download 20.69 MB at 20.69 MB/s Jul 09 15:14:22 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4314d3-38d1-4446-8e82-cbb795aeafb9]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:22 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD Jul 09 15:14:22 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:22 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.info" returned: 0 in 0.781s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:22 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.info is being set with open permissions: ugo+rw Jul 09 15:14:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:22 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.info Jul 09 15:14:22 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:23 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD" returned: 0 in 0.760s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:23 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Temporary image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 is fetched for user 05daa3d3cbe94ed6bad6e6c38c3b3645. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:14:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b477839-ecad-4024-9d20-9760bf762bc0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:23 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.info" returned: 0 in 0.662s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.101s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:23 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2d516581-7514-4cbd-b9dd-0e620c7781db tempest-SnapshotMetadataTestJSON-2102231693 None] Create snapshot completed successfully Jul 09 15:14:23 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD Jul 09 15:14:23 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:24 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a65a6d8b-36e5-44e8-ba89-e728f912329c tempest-GroupsV314Test-1137753272 None] Group tempest-GroupsV314Test-Group-1669885473: creating Jul 09 15:14:24 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a65a6d8b-36e5-44e8-ba89-e728f912329c tempest-GroupsV314Test-1137753272 None] Group tempest-GroupsV314Test-Group-1669885473: created successfully Jul 09 15:14:24 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a65a6d8b-36e5-44e8-ba89-e728f912329c tempest-GroupsV314Test-1137753272 None] Create group completed successfully. Jul 09 15:14:24 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD" returned: 0 in 0.846s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1235975815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1daaa82b-337e-45e9-b640-83e2de309780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53e662aacd54c91b899124b91b8a05d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:21Z,use_quota=True,user_id='05daa3d3cbe94ed6bad6e6c38c3b3645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Creating volume 1daaa82b-337e-45e9-b640-83e2de309780 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:24 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:24 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 1073741824 Jul 09 15:14:24 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Acquiring lock "cinder-8f8772ba-697e-41b5-968f-8a63ede36e8a-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "cinder-8f8772ba-697e-41b5-968f-8a63ede36e8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Acquiring lock "cinder-quobyte-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "cinder-quobyte-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Acquiring lock "cinder-quobyte-8f8772ba-697e-41b5-968f-8a63ede36e8a" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "cinder-quobyte-8f8772ba-697e-41b5-968f-8a63ede36e8a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Deleting offline snapshot 8f8772ba-697e-41b5-968f-8a63ede36e8a of volume 74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] snapshot_file for this snap is: volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37ca34f-1e72-4750-90eb-ccf8d68c2d37]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:24 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a Jul 09 15:14:24 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:24 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 1073741824" returned: 0 in 0.910s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:25 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 Jul 09 15:14:25 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:25 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a" returned: 0 in 0.890s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[828ecbfe-521f-45aa-b781-5b1f4e3963c8]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:25 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 Jul 09 15:14:25 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:25 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Flow 'volume_create_manager' (d8bf9e3d-e8e6-4ff5-9610-9c19f0db285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b49e38f-3185-4419-b2f0-5483c9e37c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780" returned: 0 in 0.901s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b49e38f-3185-4419-b2f0-5483c9e37c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615171950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=795df0f4-a574-451e-8cfc-f9f218ea16d1,host='devstack@QuobyteHD#QuobyteHD',id=fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c89be7d66774383a01c148ea14ffaea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:26Z,use_quota=True,user_id='adc8b624a4bb4d4aac3a34fcf8bcd561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d92c0492-c6b8-401a-a37f-626f9d7910a2),volume_type_id=d92c0492-c6b8-401a-a37f-626f9d7910a2)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e139bc8-3cc8-417a-a0ff-2ad15ce3fa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e139bc8-3cc8-417a-a0ff-2ad15ce3fa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd5f7af-38ee-42eb-a7ce-2867aeb92f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd5f7af-38ee-42eb-a7ce-2867aeb92f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7', 'volume_name': 'volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8479e3-4d41-4583-90df-a14a98a245b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8479e3-4d41-4583-90df-a14a98a245b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5db0505-623a-4f7e-92af-6808a1872eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:25 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Volume fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7', 'volume_size': 1} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=795df0f4-a574-451e-8cfc-f9f218ea16d1,created_at=2026-07-09T13:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615171950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=795df0f4-a574-451e-8cfc-f9f218ea16d1,host='devstack@QuobyteHD#QuobyteHD',id=fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c89be7d66774383a01c148ea14ffaea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:26Z,use_quota=True,user_id='adc8b624a4bb4d4aac3a34fcf8bcd561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d92c0492-c6b8-401a-a37f-626f9d7910a2),volume_type_id=d92c0492-c6b8-401a-a37f-626f9d7910a2)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Creating volume fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:25 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:14:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:26 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 1073741824 Jul 09 15:14:26 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Attempting download of 20626a8f-3a07-432c-b5dc-bd2614fa7a84 ((None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}])) to volume 1daaa82b-337e-45e9-b640-83e2de309780. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:14:26 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d88949-d4c1-450c-a52b-b92eb9da2ae2]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_8s8bk8rl {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:26 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" returned: 0 in 1.000s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:26 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a Jul 09 15:14:26 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:26 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_8s8bk8rl Jul 09 15:14:26 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:26 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_8s8bk8rl" returned: 0 in 0.830s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_8s8bk8rl {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:27 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:27 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_8s8bk8rl Jul 09 15:14:27 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a" returned: 0 in 0.944s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:27 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a Jul 09 15:14:27 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:27 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 1073741824" returned: 0 in 1.204s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:27 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 Jul 09 15:14:27 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:27 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126.8f8772ba-697e-41b5-968f-8a63ede36e8a" returned: 0 in 0.677s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:27 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_8s8bk8rl" returned: 1 in 0.884s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_8s8bk8rl' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c244c8-0e5f-496f-82c2-3011842748f3]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "cinder-quobyte-8f8772ba-697e-41b5-968f-8a63ede36e8a" released by "_delete_snapshot" :: held 3.634s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "cinder-quobyte-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" released by "delete_snapshot" :: held 3.668s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Created reservations ['6ebeddea-7832-44e5-9dc6-fbac607a13c8', '8efc4ace-0e33-46db-a2fe-71571f823908', '899093f4-04c2-462c-a60a-09289fbe76a8', '7ef9b70d-7127-4558-a51b-bede6e0ce91d'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:27 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7" returned: 0 in 0.725s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:27 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD Jul 09 15:14:27 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5db0505-623a-4f7e-92af-6808a1872eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ca0a29-667e-4a8c-a507-cb92a518100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:28 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Volume volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 (fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7): created successfully Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ca0a29-667e-4a8c-a507-cb92a518100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Flow 'volume_create_manager' (d8bf9e3d-e8e6-4ff5-9610-9c19f0db285e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:28 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Delete snapshot completed successfully. Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c28b8aaf-da19-4381-880f-4aad3195f2f8 tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "cinder-8f8772ba-697e-41b5-968f-8a63ede36e8a-delete_snapshot" released by "delete_snapshot" :: held 3.856s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:28 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f3d57f6e-5160-4b6c-b34c-52000e710dfc tempest-GroupsV314Test-1137753272 None] Created volume successfully. Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Acquiring lock "cinder-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "cinder-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Acquiring lock "cinder-quobyte-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "cinder-quobyte-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" acquired by "delete_volume" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:28 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD" returned: 0 in 0.742s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] 20626a8f-3a07-432c-b5dc-bd2614fa7a84 was qcow2, converting to raw {{(pid=87042) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[9027a38a-7d87-4415-815f-5589a008133a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:28 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 Jul 09 15:14:28 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:28 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 Jul 09 15:14:28 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:29 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Cloning volume fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 to volume dece1d11-6a68-47aa-8f92-15edd8e33581 Jul 09 15:14:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Creating offline snapshot 58dd08b4-207e-4258-b365-61e5a3b72d04 of volume fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:14:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[66890eda-8700-4c78-8ee5-5c55bf77fe33]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:29 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" returned: 0 in 0.873s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:29 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126 Jul 09 15:14:29 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:29 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 Jul 09 15:14:29 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:30 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7" returned: 0 in 0.990s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:30 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" returned: 0 in 0.921s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:30 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 1G Jul 09 15:14:30 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "cinder-quobyte-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126" released by "delete_volume" :: held 1.869s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Created reservations ['327548ff-084b-4e56-a3bc-548bba223750', '74891425-daf5-4276-8072-4ae28cca56d3', '8b6b9b01-ce0d-427d-89ad-4f0ce82adb14', 'af6bda7d-d77c-493b-ada2-56b7bf0ea2ad'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:30 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:14:30 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:31 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780" returned: 0 in 2.465s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:31 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_hr6apbc8devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:14:31 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Converted 112.00 MB image at 45.40 MB/s Jul 09 15:14:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:31 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 1G Jul 09 15:14:31 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:31 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 1G" returned: 0 in 0.917s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:31 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 Jul 09 15:14:31 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:31 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.855s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:31 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:31 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Deleted volume successfully. Jul 09 15:14:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-391c35dc-7f27-4572-8ca6-655b17d0437a tempest-SnapshotMetadataTestJSON-2102231693 None] Lock "cinder-74e99e6d-6b52-4abd-a3b6-b2ba7a0e3126-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:31 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 1G" returned: 0 in 0.902s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:32 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dd11b4-21b1-4287-be1d-0d6e0cf97279]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:32 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 Jul 09 15:14:32 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:32 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04" returned: 0 in 0.866s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:32 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:14:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:32 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 Jul 09 15:14:32 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:32 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780" returned: 0 in 0.929s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:33 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04" returned: 0 in 0.853s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:33 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.info Jul 09 15:14:33 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:33 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 Jul 09 15:14:33 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:33 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780" returned: 1 in 1.002s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:14:33 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Downloaded image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 ((None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}])) to volume 1daaa82b-337e-45e9-b640-83e2de309780 successfully. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:14:33 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:33 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Temporary image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 for user 05daa3d3cbe94ed6bad6e6c38c3b3645 is deleted. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:14:33 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Marking volume 1daaa82b-337e-45e9-b640-83e2de309780 as bootable. {{(pid=87042) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:14:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.info" returned: 0 in 0.901s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:33 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:14:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Copying metadata from image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 to 1daaa82b-337e-45e9-b640-83e2de309780. {{(pid=87042) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Creating volume glance metadata for volume 1daaa82b-337e-45e9-b640-83e2de309780 backed by image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87042) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:14:34 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.info Jul 09 15:14:34 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3eb837-b4e5-45b9-92fd-0012540f31b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1daaa82b-337e-45e9-b640-83e2de309780', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ef233a-07dc-48cf-9b83-2a2a0ced47c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:34 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Volume volume-1daaa82b-337e-45e9-b640-83e2de309780 (1daaa82b-337e-45e9-b640-83e2de309780): created successfully Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ef233a-07dc-48cf-9b83-2a2a0ced47c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Flow 'volume_create_manager' (d94064a7-c65a-4b4b-b9ab-84ef623ed99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-153729bc-0fe7-46bf-8139-628c25ca6d53 tempest-VolumesImageMetadata-1620744081 None] Created volume successfully. Jul 09 15:14:34 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.info" returned: 0 in 0.801s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Acquiring lock "cinder-quobyte-dece1d11-6a68-47aa-8f92-15edd8e33581" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Lock "cinder-quobyte-dece1d11-6a68-47aa-8f92-15edd8e33581" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] snapshot: 58dd08b4-207e-4258-b365-61e5a3b72d04, volume: dece1d11-6a68-47aa-8f92-15edd8e33581, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[755b4ab8-889f-49dd-8bb5-5e3dea5f048a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Acquiring lock "cinder-1daaa82b-337e-45e9-b640-83e2de309780-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Lock "cinder-1daaa82b-337e-45e9-b640-83e2de309780-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:35 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 Jul 09 15:14:35 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Acquiring lock "cinder-quobyte-1daaa82b-337e-45e9-b640-83e2de309780" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Lock "cinder-quobyte-1daaa82b-337e-45e9-b640-83e2de309780" acquired by "delete_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6da0ce-e8b8-40df-9711-cf1f069d669a]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:35 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 Jul 09 15:14:35 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:35 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04" returned: 0 in 0.939s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ddde3-dfe4-4eb0-aaaf-1b8388513f08]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:36 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 Jul 09 15:14:36 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:36 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780" returned: 0 in 0.977s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:36 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 Jul 09 15:14:36 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-382d26a6-90c8-4c5e-9cd0-8c2790871a09 req-3cf703d0-6a8a-44f8-9ba5-7f9ef92b761f tempest-TestShelveInstance-2000558034 None] Terminate volume connection completed successfully. Jul 09 15:14:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-382d26a6-90c8-4c5e-9cd0-8c2790871a09 req-3cf703d0-6a8a-44f8-9ba5-7f9ef92b761f tempest-TestShelveInstance-2000558034 None] Deleting attachment 37d0c043-43d0-4585-a31f-ddfbd04f7e1f. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:14:36 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Flow 'volume_create_manager' (f49a72a8-a24e-406c-89c7-644eb4ad7aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ffe551-a779-45e3-8aeb-6d6995d663e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ffe551-a779-45e3-8aeb-6d6995d663e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-232651095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592914cd-4e86-4627-b383-59e6e66b3964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5288fe20326b4d7cadf8a64d4b405196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:37Z,use_quota=True,user_id='9b0f6c163b114906a2caefde2426fc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72849b8-6113-4028-a602-70180c7e2924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72849b8-6113-4028-a602-70180c7e2924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f38ca5-8f9c-462c-ae41-099feb6edae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f38ca5-8f9c-462c-ae41-099feb6edae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592914cd-4e86-4627-b383-59e6e66b3964', 'volume_name': 'volume-592914cd-4e86-4627-b383-59e6e66b3964', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a99e38c-d452-4465-af5f-7da03a49f8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a99e38c-d452-4465-af5f-7da03a49f8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d240d53-e4b0-4bf2-b333-084861c6f78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:37 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Volume 592914cd-4e86-4627-b383-59e6e66b3964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592914cd-4e86-4627-b383-59e6e66b3964', 'volume_size': 1} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:37 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7" returned: 0 in 1.174s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:37 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 Jul 09 15:14:37 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:37 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780" returned: 1 in 0.881s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:37 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780 Jul 09 15:14:37 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:37 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1daaa82b-337e-45e9-b640-83e2de309780" returned: 0 in 0.689s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Lock "cinder-quobyte-1daaa82b-337e-45e9-b640-83e2de309780" released by "delete_volume" :: held 2.634s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Created reservations ['2769238f-bbf5-40b4-b8f0-bfef1dc56228', '0274e26e-e4c1-4ad5-86f7-985c83a53817', 'e233cd8b-4cbc-4cda-adfa-fb014ea67fbb', '109c3799-0916-4a30-a7bb-3e3b095521e2'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:38 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:14:38 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:39 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.762s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:39 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:39 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Deleted volume successfully. Jul 09 15:14:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b670fbac-cba6-4d2d-8bc9-7ce2d8851ac6 tempest-VolumesImageMetadata-1620744081 None] Lock "cinder-1daaa82b-337e-45e9-b640-83e2de309780-delete_volume" released by "delete_volume" :: held 4.696s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:43 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581" returned: 0 in 6.785s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:43 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef9ee36-c179-42d3-bdc2-a2b61d3d699d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:44 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 Jul 09 15:14:44 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:44 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7" returned: 0 in 0.936s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:44 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:14:44 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Converted 1024.00 MB image at 150.89 MB/s Jul 09 15:14:44 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:14:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:44 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 Jul 09 15:14:44 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-062c4a8e-1fe0-432b-bd34-10045d5d2e36 req-726c9a06-3c85-42be-b701-ffcb5a6e684a tempest-TestShelveInstance-2000558034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:45 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581" returned: 0 in 0.713s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Lock "cinder-quobyte-dece1d11-6a68-47aa-8f92-15edd8e33581" released by "_copy_volume_from_snapshot" :: held 10.704s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Acquiring lock "cinder-quobyte-58dd08b4-207e-4258-b365-61e5a3b72d04" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Lock "cinder-quobyte-58dd08b4-207e-4258-b365-61e5a3b72d04" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Deleting offline snapshot 58dd08b4-207e-4258-b365-61e5a3b72d04 of volume fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:14:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] snapshot_file for this snap is: volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:14:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38c21f4-cfcf-4785-bea5-1426f4cd2659]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:45 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 Jul 09 15:14:45 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:46 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04" returned: 0 in 0.819s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:14:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fc3fe4-0a21-4c2c-98ef-02fd42ab61cc]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:46 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 Jul 09 15:14:46 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:47 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7" returned: 0 in 0.775s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:47 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 Jul 09 15:14:47 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:48 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04" returned: 0 in 0.827s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:48 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04 Jul 09 15:14:48 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Flow 'volume_create_manager' (c1688115-42ea-4407-8112-286fceed8cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dbc3b9-be41-4464-9f43-7342ab8cba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dbc3b9-be41-4464-9f43-7342ab8cba53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-963942175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e63428-0337-4091-8c2d-14f73b154be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5524aed1d84c539816ecb17c52887c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:49Z,use_quota=True,user_id='e7327b52ac524557b59fb61b183b4a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1dd26e-4cd2-45c1-a87c-1c3e830cc2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1dd26e-4cd2-45c1-a87c-1c3e830cc2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7bd3c5-fe27-4a95-aa59-583dd47083b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7bd3c5-fe27-4a95-aa59-583dd47083b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e63428-0337-4091-8c2d-14f73b154be2', 'volume_name': 'volume-76e63428-0337-4091-8c2d-14f73b154be2', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c52f0a5-72dd-4610-b205-e5138e48147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c52f0a5-72dd-4610-b205-e5138e48147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26063b6-0301-4c91-a52a-a8ab4d64655b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:48 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Volume 76e63428-0337-4091-8c2d-14f73b154be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e63428-0337-4091-8c2d-14f73b154be2', 'volume_size': 1} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:48 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7.58dd08b4-207e-4258-b365-61e5a3b72d04" returned: 0 in 0.716s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Lock "cinder-quobyte-58dd08b4-207e-4258-b365-61e5a3b72d04" released by "_delete_snapshot" :: held 3.223s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.502s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.762s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-232651095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592914cd-4e86-4627-b383-59e6e66b3964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5288fe20326b4d7cadf8a64d4b405196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:37Z,use_quota=True,user_id='9b0f6c163b114906a2caefde2426fc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Creating volume 592914cd-4e86-4627-b383-59e6e66b3964 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:48 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:14:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:48 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964 1073741824 Jul 09 15:14:48 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:48 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a30f2f24-8efc-4aa9-984f-f746278db6c2 tempest-GroupsV314Test-1137753272 None] Create group from source-group-795df0f4-a574-451e-8cfc-f9f218ea16d1 completed successfully. Jul 09 15:14:49 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964 1073741824" returned: 0 in 0.841s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:49 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964 Jul 09 15:14:49 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Acquiring lock "cinder-quobyte-dece1d11-6a68-47aa-8f92-15edd8e33581" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Lock "cinder-quobyte-dece1d11-6a68-47aa-8f92-15edd8e33581" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc07597-9197-450d-8aad-e15f78214173]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:50 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964" returned: 0 in 0.709s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-062c4a8e-1fe0-432b-bd34-10045d5d2e36 req-726c9a06-3c85-42be-b701-ffcb5a6e684a tempest-TestShelveInstance-2000558034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.139s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d240d53-e4b0-4bf2-b333-084861c6f78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592914cd-4e86-4627-b383-59e6e66b3964', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bec1ff-732f-4bde-952c-2c9d7beced2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:50 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 Jul 09 15:14:50 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:50 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Volume volume-592914cd-4e86-4627-b383-59e6e66b3964 (592914cd-4e86-4627-b383-59e6e66b3964): created successfully Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bec1ff-732f-4bde-952c-2c9d7beced2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Flow 'volume_create_manager' (f49a72a8-a24e-406c-89c7-644eb4ad7aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:50 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-56bb6aa0-db3c-42be-ae1d-7b936af55f0d tempest-VolumesTransfersTest-580460766 None] Created volume successfully. Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[55379d14-79ff-4c55-a8f0-a4b28490f08f]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-062c4a8e-1fe0-432b-bd34-10045d5d2e36 req-726c9a06-3c85-42be-b701-ffcb5a6e684a tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:50 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:14:50 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:51 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581" returned: 0 in 0.859s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:51 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581 Jul 09 15:14:51 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:51 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-062c4a8e-1fe0-432b-bd34-10045d5d2e36 req-726c9a06-3c85-42be-b701-ffcb5a6e684a tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 0 in 0.870s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-062c4a8e-1fe0-432b-bd34-10045d5d2e36 req-726c9a06-3c85-42be-b701-ffcb5a6e684a tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:51 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d49245be-b378-4dd3-a996-b1f0b3f1676e tempest-VolumesTransfersTest-1786285017 None] Transfer volume completed successfully. Jul 09 15:14:51 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:14:51 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:51 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dece1d11-6a68-47aa-8f92-15edd8e33581" returned: 0 in 0.695s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Lock "cinder-quobyte-dece1d11-6a68-47aa-8f92-15edd8e33581" released by "delete_volume" :: held 1.600s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:51 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Created reservations ['e36766c6-e587-406b-a8df-bf1f24c6da9c'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:51 devstack cinder-volume[87042]: WARNING cinder.quota [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-21599572 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-21599572, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:14:51 devstack cinder-volume[87042]: WARNING cinder.quota [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-21599572 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-21599572, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Created reservations ['b5c75444-8fdf-454c-9e55-ef6a6aeb4f4e', 'b05c841c-f048-4f24-9b84-b0fe10aac311', 'd516acb2-a768-496e-8740-1f329f8fb03c', '4969c405-f7f9-4ed2-bd4f-f05d5ff5ee1f'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:52 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-062c4a8e-1fe0-432b-bd34-10045d5d2e36 req-726c9a06-3c85-42be-b701-ffcb5a6e684a tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 1 in 0.823s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-062c4a8e-1fe0-432b-bd34-10045d5d2e36 req-726c9a06-3c85-42be-b701-ffcb5a6e684a tempest-TestShelveInstance-2000558034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-062c4a8e-1fe0-432b-bd34-10045d5d2e36 req-726c9a06-3c85-42be-b701-ffcb5a6e684a tempest-TestShelveInstance-2000558034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.763s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.415s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-963942175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e63428-0337-4091-8c2d-14f73b154be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5524aed1d84c539816ecb17c52887c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:49Z,use_quota=True,user_id='e7327b52ac524557b59fb61b183b4a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Creating volume 76e63428-0337-4091-8c2d-14f73b154be2 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:52 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:14:52 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:52 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:52 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2 1073741824 Jul 09 15:14:52 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-062c4a8e-1fe0-432b-bd34-10045d5d2e36 req-726c9a06-3c85-42be-b701-ffcb5a6e684a tempest-TestShelveInstance-2000558034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-0a10a316-2c8e-42dc-a127-b18f5b66df82', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfe0ea68-c3a4-44e9-8d95-eebb59e8c11b', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:14:52 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-062c4a8e-1fe0-432b-bd34-10045d5d2e36 req-726c9a06-3c85-42be-b701-ffcb5a6e684a tempest-TestShelveInstance-2000558034 None] attachment_update completed successfully. Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Acquiring lock "cinder-quobyte-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Lock "cinder-quobyte-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c9c218-6c27-4fd5-84db-e45664cc25a4]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:52 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 Jul 09 15:14:52 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Acquiring lock "cinder-592914cd-4e86-4627-b383-59e6e66b3964-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Lock "cinder-592914cd-4e86-4627-b383-59e6e66b3964-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Acquiring lock "cinder-quobyte-592914cd-4e86-4627-b383-59e6e66b3964" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Lock "cinder-quobyte-592914cd-4e86-4627-b383-59e6e66b3964" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b87eb0-adf4-4bb8-acef-7a14662d4232]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:53 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.931s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:53 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0b37ec90-b03e-431a-bd00-3f00bf63cadb tempest-GroupsV314Test-1137753272 None] Delete group completed successfully. Jul 09 15:14:53 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964 Jul 09 15:14:53 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:53 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2 1073741824" returned: 0 in 1.138s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:53 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2 Jul 09 15:14:53 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:53 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7" returned: 0 in 0.972s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:53 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7 Jul 09 15:14:53 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:53 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964" returned: 0 in 0.896s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:53 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964 Jul 09 15:14:53 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:54 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2" returned: 0 in 0.772s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26063b6-0301-4c91-a52a-a8ab4d64655b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e63428-0337-4091-8c2d-14f73b154be2', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463bdd5c-fa10-4e18-8350-7931e5e90eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:54 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Volume volume-76e63428-0337-4091-8c2d-14f73b154be2 (76e63428-0337-4091-8c2d-14f73b154be2): created successfully Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463bdd5c-fa10-4e18-8350-7931e5e90eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Flow 'volume_create_manager' (c1688115-42ea-4407-8112-286fceed8cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:54 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c9cf8619-3439-4ca4-bae6-343022f8c6bd tempest-AbsoluteLimitsTests-531448761 None] Created volume successfully. Jul 09 15:14:54 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7" returned: 0 in 0.744s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Lock "cinder-quobyte-fdc1aae9-7ca5-4faa-b35a-c7ee1c347ec7" released by "delete_volume" :: held 1.815s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Created reservations ['18842fe6-0c09-40f3-bd21-f6cb5fd84406'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Acquiring lock "cinder-76e63428-0337-4091-8c2d-14f73b154be2-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Created reservations ['c5e74ff5-57e4-463c-9f1e-66d1ff2a98ed', '6a3b7ece-9d7f-4d1b-bee3-1ed7ad93e6d0', '4f7f3f82-136c-4852-becd-76a73602e5f1', 'f3684309-bd6f-49b6-a0ab-a20575d804f2'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Lock "cinder-76e63428-0337-4091-8c2d-14f73b154be2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Acquiring lock "cinder-quobyte-76e63428-0337-4091-8c2d-14f73b154be2" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:54 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Lock "cinder-quobyte-76e63428-0337-4091-8c2d-14f73b154be2" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-592914cd-4e86-4627-b383-59e6e66b3964" returned: 0 in 0.757s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c307d374-1871-4ec4-9452-720fd45f6396]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Lock "cinder-quobyte-592914cd-4e86-4627-b383-59e6e66b3964" released by "delete_volume" :: held 1.713s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Created reservations ['6781d0b4-ed68-4e00-b9af-47647e821a4c', '91967194-2289-4a54-80c6-dd151fa68c12', '9fe2e428-8728-43f4-8912-41edddda846b', 'fbbd7c16-845d-4a83-902c-f638d9bc4492'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:54 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:14:54 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:54 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2 Jul 09 15:14:54 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:54 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:14:54 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:55 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.873s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:55 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8bb99c0d-2300-4bf3-86be-f7cec246bed0 tempest-GroupsV314Test-1137753272 None] Delete group completed successfully. Jul 09 15:14:55 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2" returned: 0 in 1.015s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:55 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2 Jul 09 15:14:55 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:55 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.024s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:55 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Deleted volume successfully. Jul 09 15:14:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d87a6815-2662-4a7b-bb9a-6c6fe636d323 tempest-VolumesTransfersTest-1315952515 None] Lock "cinder-592914cd-4e86-4627-b383-59e6e66b3964-delete_volume" released by "delete_volume" :: held 3.021s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Flow 'volume_create_manager' (3d691525-c547-47d4-b422-220488f45b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664d2684-d06c-43ef-b3f4-68f6210bbafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664d2684-d06c-43ef-b3f4-68f6210bbafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2010516599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2adfce7-4022-4e5c-9c78-6894a9a352c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5288fe20326b4d7cadf8a64d4b405196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:56Z,use_quota=True,user_id='9b0f6c163b114906a2caefde2426fc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717f604c-dfbc-4029-9b9e-f21122bbf99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717f604c-dfbc-4029-9b9e-f21122bbf99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2411614a-d430-4afc-a70c-20511df9c242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2411614a-d430-4afc-a70c-20511df9c242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2adfce7-4022-4e5c-9c78-6894a9a352c2', 'volume_name': 'volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ad444a-5304-44b4-b5c5-afc264a38c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ad444a-5304-44b4-b5c5-afc264a38c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4313f4-7bf6-45e0-83f8-d3013629d0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:56 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Volume d2adfce7-4022-4e5c-9c78-6894a9a352c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2', 'volume_size': 1} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2010516599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2adfce7-4022-4e5c-9c78-6894a9a352c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5288fe20326b4d7cadf8a64d4b405196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:56Z,use_quota=True,user_id='9b0f6c163b114906a2caefde2426fc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Creating volume d2adfce7-4022-4e5c-9c78-6894a9a352c2 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:56 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:56 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2 1073741824 Jul 09 15:14:56 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:56 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-76e63428-0337-4091-8c2d-14f73b154be2" returned: 0 in 0.780s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Lock "cinder-quobyte-76e63428-0337-4091-8c2d-14f73b154be2" released by "delete_volume" :: held 1.853s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Created reservations ['4a71413e-6437-4f3e-a6a2-e869d531a05b', '6a6a8426-91c2-444e-b7a4-24a6fb88810b', '68490194-0209-450b-beb5-0590da4417f3', '5ef35e18-ab82-432d-953e-7dd1b9f59730'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:56 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:14:56 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:57 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2 1073741824" returned: 0 in 1.112s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:57 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2 Jul 09 15:14:57 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:57 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.987s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:57 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:57 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Deleted volume successfully. Jul 09 15:14:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09df6ece-066f-4c43-8acd-e5fd84f32dbd tempest-AbsoluteLimitsTests-531448761 None] Lock "cinder-76e63428-0337-4091-8c2d-14f73b154be2-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:58 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2" returned: 0 in 0.875s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4313f4-7bf6-45e0-83f8-d3013629d0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca63ee0-9b1a-45c0-ae88-1a83165b6653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:58 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Volume volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2 (d2adfce7-4022-4e5c-9c78-6894a9a352c2): created successfully Jul 09 15:14:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca63ee0-9b1a-45c0-ae88-1a83165b6653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Flow 'volume_create_manager' (3d691525-c547-47d4-b422-220488f45b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:58 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-553ed372-e1aa-4993-904e-e1f0ce3bd4c5 tempest-VolumesTransfersTest-580460766 None] Created volume successfully. Jul 09 15:14:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Acquiring lock "cinder-d2adfce7-4022-4e5c-9c78-6894a9a352c2-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Lock "cinder-d2adfce7-4022-4e5c-9c78-6894a9a352c2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Acquiring lock "cinder-quobyte-d2adfce7-4022-4e5c-9c78-6894a9a352c2" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Lock "cinder-quobyte-d2adfce7-4022-4e5c-9c78-6894a9a352c2" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:59 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[0635afc5-4b47-42cb-a0ca-218bf5db0d1e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:00 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2 Jul 09 15:15:00 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:00 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2" returned: 0 in 0.992s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:00 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2 Jul 09 15:15:00 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:01 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d2adfce7-4022-4e5c-9c78-6894a9a352c2" returned: 0 in 0.816s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Lock "cinder-quobyte-d2adfce7-4022-4e5c-9c78-6894a9a352c2" released by "delete_volume" :: held 1.872s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:01 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Created reservations ['d1e8e6f5-2e1e-4b03-8ef0-d3fc22864239', '3a6ce3e0-c803-4630-a45c-14c078cbf4c2', '574e2565-4e5e-4f25-9d0f-546161797c2a', '215ac48e-b432-496b-8515-e802c4d4982e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:01 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:01 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:02 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.873s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:02 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:02 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Deleted volume successfully. Jul 09 15:15:02 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=116,cinder:UPDATE=124,cinder:INSERT=35,cinder:DELETE=8 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:15:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ce9a9140-4d88-49b2-810c-03bdba5f555b tempest-VolumesTransfersTest-1315952515 None] Lock "cinder-d2adfce7-4022-4e5c-9c78-6894a9a352c2-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:15:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:04 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:04 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:05 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.021s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:15:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:15:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:15:06 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=105,cinder:UPDATE=131,cinder:DELETE=7,cinder:INSERT=36 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:15:06 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Flow 'volume_create_manager' (f205a8e4-6c3e-4732-b485-513a79101f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252ddfe5-03e3-4ac8-824e-f61dd1c3207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252ddfe5-03e3-4ac8-824e-f61dd1c3207f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1192347296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d29587f-8089-481e-bdcf-cf7368337282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40cf8b214997467db69511f1d0abdbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:07Z,use_quota=True,user_id='2c65c85e621a48f4afe5ad2f83eeb692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30dc9f4-7805-44e2-a7f9-4d562e69f6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30dc9f4-7805-44e2-a7f9-4d562e69f6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6eafc89-919d-4494-aae6-8488219d43e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6eafc89-919d-4494-aae6-8488219d43e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d29587f-8089-481e-bdcf-cf7368337282', 'volume_name': 'volume-7d29587f-8089-481e-bdcf-cf7368337282', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb7c8ed-b379-4ca2-9ba8-f9fab25f4461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb7c8ed-b379-4ca2-9ba8-f9fab25f4461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7556586c-8caa-497f-aa00-05935b87f0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:07 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Volume 7d29587f-8089-481e-bdcf-cf7368337282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d29587f-8089-481e-bdcf-cf7368337282', 'volume_size': 1} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1192347296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d29587f-8089-481e-bdcf-cf7368337282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40cf8b214997467db69511f1d0abdbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:07Z,use_quota=True,user_id='2c65c85e621a48f4afe5ad2f83eeb692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Creating volume 7d29587f-8089-481e-bdcf-cf7368337282 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:07 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:15:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:07 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282 1073741824 Jul 09 15:15:07 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:08 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282 1073741824" returned: 0 in 1.267s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:08 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282 Jul 09 15:15:08 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:09 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282" returned: 0 in 0.882s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7556586c-8caa-497f-aa00-05935b87f0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d29587f-8089-481e-bdcf-cf7368337282', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d0bff7-d9aa-4c26-84b0-b46e1d78ba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:09 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Volume volume-7d29587f-8089-481e-bdcf-cf7368337282 (7d29587f-8089-481e-bdcf-cf7368337282): created successfully Jul 09 15:15:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d0bff7-d9aa-4c26-84b0-b46e1d78ba5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Flow 'volume_create_manager' (f205a8e4-6c3e-4732-b485-513a79101f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0242cf27-4bdb-4a65-8ddf-785c252a4a55 tempest-VolumesTransfersV357Test-6574896 None] Created volume successfully. Jul 09 15:15:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-4a819ae0-4765-4439-9e22-82985dd3e18f tempest-VolumesTransfersV357Test-1284534697 None] Transfer volume completed successfully. Jul 09 15:15:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Acquiring lock "cinder-7d29587f-8089-481e-bdcf-cf7368337282-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Lock "cinder-7d29587f-8089-481e-bdcf-cf7368337282-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Acquiring lock "cinder-quobyte-7d29587f-8089-481e-bdcf-cf7368337282" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Lock "cinder-quobyte-7d29587f-8089-481e-bdcf-cf7368337282" acquired by "delete_volume" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:12 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ff4a48-aa1f-4a00-bcbf-558f5828fc4e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:12 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282 Jul 09 15:15:12 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:13 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282" returned: 0 in 0.887s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:13 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282 Jul 09 15:15:13 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:13 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Flow 'volume_create_manager' (b6db6b36-c012-4bf7-a70c-a7beab5d2685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75575cb7-02b8-42c6-bc26-39855db923c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75575cb7-02b8-42c6-bc26-39855db923c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-365289442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4ca624-a95f-4352-a70b-e25117454556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393dc1c8f0fc4972a36dbc3bbebd822a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:14Z,use_quota=True,user_id='fe72bb13c2434e3eb4b9c0394fa68478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51c80dd-56fa-4368-8b8f-a2f30856a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51c80dd-56fa-4368-8b8f-a2f30856a414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96fe75c-ccec-4cff-ba2d-614861521c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96fe75c-ccec-4cff-ba2d-614861521c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4ca624-a95f-4352-a70b-e25117454556', 'volume_name': 'volume-2b4ca624-a95f-4352-a70b-e25117454556', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffe9b1c-0ef7-4cc9-b880-d3862da8ef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffe9b1c-0ef7-4cc9-b880-d3862da8ef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d113fc-66e2-4c24-88ef-d50f34de0b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:14 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Volume 2b4ca624-a95f-4352-a70b-e25117454556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4ca624-a95f-4352-a70b-e25117454556', 'volume_size': 1} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-365289442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4ca624-a95f-4352-a70b-e25117454556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393dc1c8f0fc4972a36dbc3bbebd822a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:14Z,use_quota=True,user_id='fe72bb13c2434e3eb4b9c0394fa68478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Creating volume 2b4ca624-a95f-4352-a70b-e25117454556 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:14 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:14 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556 1073741824 Jul 09 15:15:14 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:14 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7d29587f-8089-481e-bdcf-cf7368337282" returned: 0 in 0.916s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Lock "cinder-quobyte-7d29587f-8089-481e-bdcf-cf7368337282" released by "delete_volume" :: held 1.854s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Created reservations ['97f771c5-1082-44ea-a19e-9b241b728ecc', '08c4c44e-2563-4086-b612-c6f3d7dc0200', 'b0aa077e-8168-4bdc-9948-9f49e48efc07', '0854b67b-45f8-44cf-b75c-045cec94c883'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:14 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:14 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:15 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556 1073741824" returned: 0 in 1.443s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:15 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.119s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:15 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Deleted volume successfully. Jul 09 15:15:15 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556 Jul 09 15:15:15 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc117974-c73d-4d35-8787-660acb2f948f tempest-VolumesTransfersV357Test-402019501 None] Lock "cinder-7d29587f-8089-481e-bdcf-cf7368337282-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Flow 'volume_create_manager' (cd715db1-fa63-4755-a66c-c1013c1aacf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ff6b88-e149-4042-8d41-f23856abaeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ff6b88-e149-4042-8d41-f23856abaeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-997570168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6de0d12-83de-4896-8f87-668acca4314e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40cf8b214997467db69511f1d0abdbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:16Z,use_quota=True,user_id='2c65c85e621a48f4afe5ad2f83eeb692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82604020-1033-4f6f-8d8c-df29a04c7443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82604020-1033-4f6f-8d8c-df29a04c7443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d8f40d-3264-409e-b5a0-0ca23b9b8ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d8f40d-3264-409e-b5a0-0ca23b9b8ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6de0d12-83de-4896-8f87-668acca4314e', 'volume_name': 'volume-c6de0d12-83de-4896-8f87-668acca4314e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473eac44-46ae-40fe-8bb5-83cb6c1beac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473eac44-46ae-40fe-8bb5-83cb6c1beac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92af9425-26a4-4ddb-b61e-590cbf882ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:15 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Volume c6de0d12-83de-4896-8f87-668acca4314e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6de0d12-83de-4896-8f87-668acca4314e', 'volume_size': 1} Jul 09 15:15:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:16 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556" returned: 0 in 0.848s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] <== create_volume: return (2398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.401s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-997570168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6de0d12-83de-4896-8f87-668acca4314e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40cf8b214997467db69511f1d0abdbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:16Z,use_quota=True,user_id='2c65c85e621a48f4afe5ad2f83eeb692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Creating volume c6de0d12-83de-4896-8f87-668acca4314e {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:16 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d113fc-66e2-4c24-88ef-d50f34de0b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4ca624-a95f-4352-a70b-e25117454556', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1024d7e-50d5-40e7-b06d-b4d9f724eb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:16 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e 1073741824 Jul 09 15:15:16 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:16 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Volume volume-2b4ca624-a95f-4352-a70b-e25117454556 (2b4ca624-a95f-4352-a70b-e25117454556): created successfully Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1024d7e-50d5-40e7-b06d-b4d9f724eb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Flow 'volume_create_manager' (b6db6b36-c012-4bf7-a70c-a7beab5d2685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:16 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-02003fea-5b08-4fdd-847d-e73ddde9bf7f tempest-VolumesTransfersV355Test-836542286 None] Created volume successfully. Jul 09 15:15:17 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e 1073741824" returned: 0 in 1.119s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:17 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e Jul 09 15:15:17 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:18 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7893f8d3-b373-459d-8e7e-8c24f315b98c tempest-VolumesTransfersV355Test-1900613710 None] Transfer volume completed successfully. Jul 09 15:15:18 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e" returned: 0 in 0.882s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92af9425-26a4-4ddb-b61e-590cbf882ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6de0d12-83de-4896-8f87-668acca4314e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2d758d-030a-41c4-97d9-50b5f2eb54d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:18 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Volume volume-c6de0d12-83de-4896-8f87-668acca4314e (c6de0d12-83de-4896-8f87-668acca4314e): created successfully Jul 09 15:15:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2d758d-030a-41c4-97d9-50b5f2eb54d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Flow 'volume_create_manager' (cd715db1-fa63-4755-a66c-c1013c1aacf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:18 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-705ebf84-3f65-4d65-8a96-9d5150169b62 tempest-VolumesTransfersV357Test-6574896 None] Created volume successfully. Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Flow 'volume_create_manager' (21fac316-4d5d-4cba-8895-e4ddd6cecc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61b6d04-3d52-4a27-8f70-cdec8b489ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61b6d04-3d52-4a27-8f70-cdec8b489ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-342537775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb1ef0d-76c7-4125-8eae-9ef0d8664508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ce2a79bbe04351b96577a5b2c71aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:19Z,use_quota=True,user_id='40d9b0712d014833a3467c293376ebc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6ebae8-5142-446a-bbcb-7d2c2e143f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6ebae8-5142-446a-bbcb-7d2c2e143f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2274331f-13bb-4fd0-95db-7658bd1719be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2274331f-13bb-4fd0-95db-7658bd1719be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb1ef0d-76c7-4125-8eae-9ef0d8664508', 'volume_name': 'volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a292df5d-710b-4ca3-b4a8-83df81faaa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a292df5d-710b-4ca3-b4a8-83df81faaa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f59eb26-c8f5-46ed-a62b-6f1739ee4fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:19 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Volume 3bb1ef0d-76c7-4125-8eae-9ef0d8664508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508', 'volume_size': 1} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-342537775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb1ef0d-76c7-4125-8eae-9ef0d8664508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ce2a79bbe04351b96577a5b2c71aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:19Z,use_quota=True,user_id='40d9b0712d014833a3467c293376ebc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Creating volume 3bb1ef0d-76c7-4125-8eae-9ef0d8664508 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:19 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:19 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508 1073741824 Jul 09 15:15:19 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Acquiring lock "cinder-2b4ca624-a95f-4352-a70b-e25117454556-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Lock "cinder-2b4ca624-a95f-4352-a70b-e25117454556-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Acquiring lock "cinder-c6de0d12-83de-4896-8f87-668acca4314e-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Lock "cinder-c6de0d12-83de-4896-8f87-668acca4314e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Acquiring lock "cinder-quobyte-2b4ca624-a95f-4352-a70b-e25117454556" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Acquiring lock "cinder-quobyte-c6de0d12-83de-4896-8f87-668acca4314e" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Lock "cinder-quobyte-2b4ca624-a95f-4352-a70b-e25117454556" acquired by "delete_volume" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Lock "cinder-quobyte-c6de0d12-83de-4896-8f87-668acca4314e" acquired by "delete_volume" :: waited 0.035s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[0113ccc7-86d2-43bd-99fa-bc938204004b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23f5cc4-661f-4caa-88fe-e49b8c957f1b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:19 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e Jul 09 15:15:19 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:19 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556 Jul 09 15:15:19 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:20 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508 1073741824" returned: 0 in 1.133s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:20 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508 Jul 09 15:15:20 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:20 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556" returned: 0 in 0.964s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:20 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e" returned: 0 in 0.959s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:20 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556 Jul 09 15:15:20 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:20 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e Jul 09 15:15:20 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:21 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508" returned: 0 in 0.903s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f59eb26-c8f5-46ed-a62b-6f1739ee4fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64c7892-e7e9-4694-bcd8-74606ae34234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Volume volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508 (3bb1ef0d-76c7-4125-8eae-9ef0d8664508): created successfully Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64c7892-e7e9-4694-bcd8-74606ae34234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Flow 'volume_create_manager' (21fac316-4d5d-4cba-8895-e4ddd6cecc69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:21 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-95878a6f-5b59-4808-89ec-01383f4a351d tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Created volume successfully. Jul 09 15:15:21 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c6de0d12-83de-4896-8f87-668acca4314e" returned: 0 in 0.906s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Lock "cinder-quobyte-c6de0d12-83de-4896-8f87-668acca4314e" released by "delete_volume" :: held 1.917s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:21 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2b4ca624-a95f-4352-a70b-e25117454556" returned: 0 in 0.949s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Lock "cinder-quobyte-2b4ca624-a95f-4352-a70b-e25117454556" released by "delete_volume" :: held 1.968s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Created reservations ['14782ddf-087f-412c-ab8d-17478af34a35', 'a3f14e38-a8db-4525-912f-f66885b7675f', 'd90003b5-4a07-48f5-8074-1c7152ae35ac', '04ed4628-9975-4a8b-83b6-4cbd450cadb9'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Created reservations ['30eb3a7d-9be0-4851-a822-5ef5004a6eac', '216b69e2-5300-4d7b-b271-6321d6aac7ee', '39832fab-d7bc-4f52-868c-92612dbe3cd3', 'aaf74c7b-0f04-412f-af31-fd874ed94998'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:21 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:21 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:21 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:21 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:22 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.733s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:22 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Deleted volume successfully. Jul 09 15:15:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e938cd57-4cbf-4655-8f4f-ea37bd407876 tempest-VolumesTransfersV357Test-402019501 None] Lock "cinder-c6de0d12-83de-4896-8f87-668acca4314e-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:22 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.756s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:22 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Deleted volume successfully. Jul 09 15:15:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-16446154-0c7e-4671-b5a3-f296c1a1c2f1 tempest-VolumesTransfersV355Test-1018898380 None] Lock "cinder-2b4ca624-a95f-4352-a70b-e25117454556-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Flow 'volume_create_manager' (f7558bad-3e92-4b11-9cbb-07befc04553a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a12c77-454c-4bcd-97cf-bf8eacf9d0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a12c77-454c-4bcd-97cf-bf8eacf9d0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-646338573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a29d18-a17a-4260-bcc9-efcce646550d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393dc1c8f0fc4972a36dbc3bbebd822a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:23Z,use_quota=True,user_id='fe72bb13c2434e3eb4b9c0394fa68478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ffa87f-5291-4114-9b54-b487c9b962b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ffa87f-5291-4114-9b54-b487c9b962b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f06a53-2d21-4f04-a534-7d1678bce6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f06a53-2d21-4f04-a534-7d1678bce6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a29d18-a17a-4260-bcc9-efcce646550d', 'volume_name': 'volume-86a29d18-a17a-4260-bcc9-efcce646550d', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775a9b8a-8c72-471e-84a1-c45746efdef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775a9b8a-8c72-471e-84a1-c45746efdef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118255be-f1e0-4f68-835b-f09ffb88b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Volume 86a29d18-a17a-4260-bcc9-efcce646550d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a29d18-a17a-4260-bcc9-efcce646550d', 'volume_size': 1} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-646338573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a29d18-a17a-4260-bcc9-efcce646550d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393dc1c8f0fc4972a36dbc3bbebd822a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:23Z,use_quota=True,user_id='fe72bb13c2434e3eb4b9c0394fa68478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Creating volume 86a29d18-a17a-4260-bcc9-efcce646550d {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:23 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Acquiring lock "cinder-3bb1ef0d-76c7-4125-8eae-9ef0d8664508-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:23 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d 1073741824 Jul 09 15:15:23 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Lock "cinder-3bb1ef0d-76c7-4125-8eae-9ef0d8664508-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Acquiring lock "cinder-quobyte-3bb1ef0d-76c7-4125-8eae-9ef0d8664508" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Lock "cinder-quobyte-3bb1ef0d-76c7-4125-8eae-9ef0d8664508" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[004e6929-438e-4dba-8c33-5bc5ee872de7]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:23 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508 Jul 09 15:15:23 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:24 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d 1073741824" returned: 0 in 0.958s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:24 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d Jul 09 15:15:24 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:24 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508" returned: 0 in 0.927s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:24 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508 Jul 09 15:15:24 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:25 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d" returned: 0 in 0.687s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118255be-f1e0-4f68-835b-f09ffb88b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a29d18-a17a-4260-bcc9-efcce646550d', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519e872b-0e0e-470b-a8d4-368e20258670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:25 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Volume volume-86a29d18-a17a-4260-bcc9-efcce646550d (86a29d18-a17a-4260-bcc9-efcce646550d): created successfully Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519e872b-0e0e-470b-a8d4-368e20258670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Flow 'volume_create_manager' (f7558bad-3e92-4b11-9cbb-07befc04553a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d47b94dd-bf24-4a67-8e84-ec2f98f530e4 tempest-VolumesTransfersV355Test-836542286 None] Created volume successfully. Jul 09 15:15:25 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3bb1ef0d-76c7-4125-8eae-9ef0d8664508" returned: 0 in 0.750s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Lock "cinder-quobyte-3bb1ef0d-76c7-4125-8eae-9ef0d8664508" released by "delete_volume" :: held 1.724s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Created reservations ['58b65e66-b426-42a0-93c4-026fc2d96fc4', '0fa84741-2069-4a54-af92-66add9be1c03', '7e078798-b1f0-4d10-8a25-3ec1d89dbf50', '761df22c-5b75-4f65-bdc1-00a1fed07628'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:25 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:25 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Acquiring lock "cinder-86a29d18-a17a-4260-bcc9-efcce646550d-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Lock "cinder-86a29d18-a17a-4260-bcc9-efcce646550d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Acquiring lock "cinder-quobyte-86a29d18-a17a-4260-bcc9-efcce646550d" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Lock "cinder-quobyte-86a29d18-a17a-4260-bcc9-efcce646550d" acquired by "delete_volume" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf4764c-9858-480f-836f-33d67ddd297e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:26 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d Jul 09 15:15:26 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:26 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.853s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:26 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Deleted volume successfully. Jul 09 15:15:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-99e35b7c-cb79-49db-9935-65dcfccca6ff tempest-VolumeQuotasNegativeTestJSON-1896096025 None] Lock "cinder-3bb1ef0d-76c7-4125-8eae-9ef0d8664508-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:26 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d" returned: 0 in 0.885s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:26 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d Jul 09 15:15:26 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:27 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-86a29d18-a17a-4260-bcc9-efcce646550d" returned: 0 in 0.725s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Lock "cinder-quobyte-86a29d18-a17a-4260-bcc9-efcce646550d" released by "delete_volume" :: held 1.685s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:27 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Created reservations ['10a1e191-d024-4e70-a747-b919d8da3730', '3d2d9cde-7567-4a31-b618-1d2dd03840ca', '5e035c07-af24-4ea9-9b75-d8d883b7c40c', 'ab00a75f-7ebd-49f3-bf53-5bf0cb832cfb'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:27 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:27 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:28 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.003s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:28 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:28 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Deleted volume successfully. Jul 09 15:15:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2955e556-470e-48e1-8e94-176d05be9d4a tempest-VolumesTransfersV355Test-1018898380 None] Lock "cinder-86a29d18-a17a-4260-bcc9-efcce646550d-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Flow 'volume_create_manager' (8e5ea25b-4482-4e66-ad19-16154aa9ccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17032cbe-ab0a-4bd9-b80f-b71033cd1917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17032cbe-ab0a-4bd9-b80f-b71033cd1917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1410109590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc373be9-8519-4eb6-878f-44851618c034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d7e48988f143baa3baaffab051f181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:33Z,use_quota=True,user_id='efef281361f74a488e6ecc833f355ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(756256ef-0b31-4191-b92b-72e1b02556c8),volume_type_id=756256ef-0b31-4191-b92b-72e1b02556c8)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9b2e12-28e7-41f2-881d-345defceb4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9b2e12-28e7-41f2-881d-345defceb4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc217975-5d37-4dac-8eeb-ee7a37d48ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc217975-5d37-4dac-8eeb-ee7a37d48ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc373be9-8519-4eb6-878f-44851618c034', 'volume_name': 'volume-dc373be9-8519-4eb6-878f-44851618c034', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790279c2-5d92-49fd-bbe9-277bcb42d346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790279c2-5d92-49fd-bbe9-277bcb42d346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a693c263-d513-4acd-a580-691cbd936402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:33 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Volume dc373be9-8519-4eb6-878f-44851618c034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc373be9-8519-4eb6-878f-44851618c034', 'volume_size': 1} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1410109590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc373be9-8519-4eb6-878f-44851618c034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d7e48988f143baa3baaffab051f181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:33Z,use_quota=True,user_id='efef281361f74a488e6ecc833f355ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(756256ef-0b31-4191-b92b-72e1b02556c8),volume_type_id=756256ef-0b31-4191-b92b-72e1b02556c8)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Creating volume dc373be9-8519-4eb6-878f-44851618c034 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:33 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:15:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:33 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034 1073741824 Jul 09 15:15:33 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:34 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034 1073741824" returned: 0 in 1.063s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:34 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034 Jul 09 15:15:34 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:35 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034" returned: 0 in 0.873s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a693c263-d513-4acd-a580-691cbd936402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc373be9-8519-4eb6-878f-44851618c034', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d18790-f207-48df-ba6d-0e6b2dbcf7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:35 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Volume volume-dc373be9-8519-4eb6-878f-44851618c034 (dc373be9-8519-4eb6-878f-44851618c034): created successfully Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d18790-f207-48df-ba6d-0e6b2dbcf7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Flow 'volume_create_manager' (8e5ea25b-4482-4e66-ad19-16154aa9ccc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e88cfbd0-b490-4c84-ae46-f54eb4644feb tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Created volume successfully. Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Flow 'volume_create_manager' (31fb5a02-150b-495a-8a8f-c68e7288bbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1baeca8-ffe7-40c7-8275-a97438c9a52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1baeca8-ffe7-40c7-8275-a97438c9a52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-519079904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405c6ac5-c988-4838-b691-780f368e29b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7794045c91542a48d4de60d3293673a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:36Z,use_quota=True,user_id='ee214fa3c47149179978d712e96d7d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac3fd77-701f-4701-a4b9-bfff319e7d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac3fd77-701f-4701-a4b9-bfff319e7d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8782817-0459-44df-85a4-2eb8892b17d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8782817-0459-44df-85a4-2eb8892b17d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '405c6ac5-c988-4838-b691-780f368e29b9', 'volume_name': 'volume-405c6ac5-c988-4838-b691-780f368e29b9', 'volume_size': 2}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0d6736-96df-45ba-916f-91f7cd4f12f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0d6736-96df-45ba-916f-91f7cd4f12f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d1a85a-4aa3-43e4-aec7-09cc49902117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:35 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Volume 405c6ac5-c988-4838-b691-780f368e29b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-405c6ac5-c988-4838-b691-780f368e29b9', 'volume_size': 2} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-519079904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405c6ac5-c988-4838-b691-780f368e29b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7794045c91542a48d4de60d3293673a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:36Z,use_quota=True,user_id='ee214fa3c47149179978d712e96d7d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Creating volume 405c6ac5-c988-4838-b691-780f368e29b9 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:35 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:15:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9 2147483648 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:35 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9 2147483648 Jul 09 15:15:35 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:37 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9 2147483648" returned: 0 in 1.041s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-820f0589-3e3f-4c62-8edd-7c887f9af989 tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-820f0589-3e3f-4c62-8edd-7c887f9af989 tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-820f0589-3e3f-4c62-8edd-7c887f9af989 tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-820f0589-3e3f-4c62-8edd-7c887f9af989 tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-820f0589-3e3f-4c62-8edd-7c887f9af989 tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-820f0589-3e3f-4c62-8edd-7c887f9af989 tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:37 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:37 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:37 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9 Jul 09 15:15:37 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:37 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-820f0589-3e3f-4c62-8edd-7c887f9af989 tempest-VolumeRetypeWithoutMigrationTest-243713091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.667s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-820f0589-3e3f-4c62-8edd-7c887f9af989 tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-820f0589-3e3f-4c62-8edd-7c887f9af989 tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Retype volume completed successfully. Jul 09 15:15:37 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9" returned: 0 in 0.734s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d1a85a-4aa3-43e4-aec7-09cc49902117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405c6ac5-c988-4838-b691-780f368e29b9', 'volume_size': 2}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61cc725-4d19-4858-a19b-9822131f7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:37 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Volume volume-405c6ac5-c988-4838-b691-780f368e29b9 (405c6ac5-c988-4838-b691-780f368e29b9): created successfully Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61cc725-4d19-4858-a19b-9822131f7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Flow 'volume_create_manager' (31fb5a02-150b-495a-8a8f-c68e7288bbeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7f18c95c-dc6e-4473-b8de-27acf9cbed3f tempest-VolumesCloneNegativeTest-344128560 None] Created volume successfully. Jul 09 15:15:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Acquiring lock "cinder-dc373be9-8519-4eb6-878f-44851618c034-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "cinder-dc373be9-8519-4eb6-878f-44851618c034-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Acquiring lock "cinder-quobyte-dc373be9-8519-4eb6-878f-44851618c034" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "cinder-quobyte-dc373be9-8519-4eb6-878f-44851618c034" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:38 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff1b755-b0b9-4916-8333-af2f91b6034f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:38 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034 Jul 09 15:15:38 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Acquiring lock "cinder-405c6ac5-c988-4838-b691-780f368e29b9-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Lock "cinder-405c6ac5-c988-4838-b691-780f368e29b9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:39 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034" returned: 0 in 0.823s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:39 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034 Jul 09 15:15:39 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Acquiring lock "cinder-quobyte-405c6ac5-c988-4838-b691-780f368e29b9" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Lock "cinder-quobyte-405c6ac5-c988-4838-b691-780f368e29b9" acquired by "delete_volume" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:39 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ca17b6-8404-413a-a386-153e428bf2bb]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:39 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9 Jul 09 15:15:39 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:39 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-dc373be9-8519-4eb6-878f-44851618c034" returned: 0 in 0.743s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "cinder-quobyte-dc373be9-8519-4eb6-878f-44851618c034" released by "delete_volume" :: held 1.654s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:40 devstack cinder-volume[87042]: WARNING cinder.quota [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:15:40 devstack cinder-volume[87042]: WARNING cinder.quota [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Created reservations ['82d6d937-8743-4a12-9c4b-9487945eae73', '0324157c-4198-4214-ac7f-3a3b927d8383', '848588aa-477d-4dd8-8272-f005ec6c0e11', 'e3d81e69-8058-449b-8fde-321844677903'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:40 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:40 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Flow 'volume_create_manager' (dd7a7af0-ac93-467b-b6a1-bff17baac49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68c53b8-89d1-40de-b719-b29e1db8e83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68c53b8-89d1-40de-b719-b29e1db8e83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-729000570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27709403-1355-4a58-a24d-68bebb4e1ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3a16f1469d4fde8978c60e2c7a7078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:40Z,use_quota=True,user_id='0b0cf55a8fd2434389a77de0377804f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787540c5-8d79-4a9a-93eb-349b023f791c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787540c5-8d79-4a9a-93eb-349b023f791c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99b4dd6-72bc-4910-88c7-40895a9d05e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99b4dd6-72bc-4910-88c7-40895a9d05e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27709403-1355-4a58-a24d-68bebb4e1ac5', 'volume_name': 'volume-27709403-1355-4a58-a24d-68bebb4e1ac5', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5ddad5-356b-4832-864b-bef394714661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5ddad5-356b-4832-864b-bef394714661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:40 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9379481c-631a-4f1a-8c7d-023895a9e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:40 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Volume 27709403-1355-4a58-a24d-68bebb4e1ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27709403-1355-4a58-a24d-68bebb4e1ac5', 'volume_size': 1} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-729000570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27709403-1355-4a58-a24d-68bebb4e1ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3a16f1469d4fde8978c60e2c7a7078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:40Z,use_quota=True,user_id='0b0cf55a8fd2434389a77de0377804f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Creating volume 27709403-1355-4a58-a24d-68bebb4e1ac5 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:40 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9" returned: 0 in 0.980s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:40 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 1073741824 Jul 09 15:15:40 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:40 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9 Jul 09 15:15:40 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:40 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.713s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:40 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Deleted volume successfully. Jul 09 15:15:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e040f39f-abb7-4efd-b816-d8b3101357ac tempest-VolumeRetypeWithoutMigrationTest-243713091 None] Lock "cinder-dc373be9-8519-4eb6-878f-44851618c034-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:41 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-405c6ac5-c988-4838-b691-780f368e29b9" returned: 0 in 0.813s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Lock "cinder-quobyte-405c6ac5-c988-4838-b691-780f368e29b9" released by "delete_volume" :: held 1.859s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Created reservations ['c865247b-3d5b-4341-bf23-c48582863a11', 'd6f2c5f3-35c9-4748-9bac-c9cf30b6c0a2', '0cf22d53-f694-4445-8565-ee1eb34cdd39', 'e0b959e6-c6c2-4d24-8f5e-7c43bef1539f'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:41 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 1073741824" returned: 0 in 0.988s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:41 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:41 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:41 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 Jul 09 15:15:41 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:42 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5" returned: 0 in 0.784s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:42 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.854s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:42 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:42 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Deleted volume successfully. Jul 09 15:15:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9379481c-631a-4f1a-8c7d-023895a9e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27709403-1355-4a58-a24d-68bebb4e1ac5', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581a9af6-614d-4f47-a3e9-0a8807cc96d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:42 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Volume volume-27709403-1355-4a58-a24d-68bebb4e1ac5 (27709403-1355-4a58-a24d-68bebb4e1ac5): created successfully Jul 09 15:15:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581a9af6-614d-4f47-a3e9-0a8807cc96d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Flow 'volume_create_manager' (dd7a7af0-ac93-467b-b6a1-bff17baac49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-800803d0-f488-4603-8803-ae2c8fcafa66 tempest-VolumesCloneNegativeTest-344128560 None] Lock "cinder-405c6ac5-c988-4838-b691-780f368e29b9-delete_volume" released by "delete_volume" :: held 3.021s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:42 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c40aa193-fabd-4a1b-9849-b40a6dc7e34c tempest-VolumesActionsTest-1619489636 None] Created volume successfully. Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Flow 'volume_create_manager' (47162705-0fc9-4bef-91f3-07f3741e3239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6472d4b-da1e-4f20-b7e6-721a93e684de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6472d4b-da1e-4f20-b7e6-721a93e684de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-116256691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff0311d-ae3b-47ac-9914-a1b3f4b78794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0a788b70cc45d088e1dd17ffed99f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:46Z,use_quota=True,user_id='35838bce91624bce9be479a112ce4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bf005a-7284-4b9e-9ffd-e35ee13dff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bf005a-7284-4b9e-9ffd-e35ee13dff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2a7148-2626-4862-8b89-7cd528a33d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2a7148-2626-4862-8b89-7cd528a33d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff0311d-ae3b-47ac-9914-a1b3f4b78794', 'volume_name': 'volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca62ede-2ec4-4e00-9bd1-d2754bcdaf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca62ede-2ec4-4e00-9bd1-d2754bcdaf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d35ad2-fa72-46e6-bc0f-ef8852b53e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:45 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Volume 5ff0311d-ae3b-47ac-9914-a1b3f4b78794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794', 'volume_size': 1} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-116256691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff0311d-ae3b-47ac-9914-a1b3f4b78794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0a788b70cc45d088e1dd17ffed99f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:46Z,use_quota=True,user_id='35838bce91624bce9be479a112ce4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Creating volume 5ff0311d-ae3b-47ac-9914-a1b3f4b78794 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:45 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:15:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:45 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794 1073741824 Jul 09 15:15:45 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:47 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794 1073741824" returned: 0 in 1.321s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:47 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794 Jul 09 15:15:47 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:47 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794" returned: 0 in 0.850s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d35ad2-fa72-46e6-bc0f-ef8852b53e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26a8e6f-c0f9-4374-9b6f-93f604d17c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:48 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Volume volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794 (5ff0311d-ae3b-47ac-9914-a1b3f4b78794): created successfully Jul 09 15:15:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26a8e6f-c0f9-4374-9b6f-93f604d17c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Flow 'volume_create_manager' (47162705-0fc9-4bef-91f3-07f3741e3239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:48 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c3ef63ee-88e9-43f2-ba82-be6b1af21098 tempest-VolumesNegativeTest-19136828 None] Created volume successfully. Jul 09 15:15:48 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-b41adc95-bb9c-400e-8208-f9ca9422f91e tempest-TestShelveInstance-2000558034 None] Terminate volume connection completed successfully. Jul 09 15:15:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-b41adc95-bb9c-400e-8208-f9ca9422f91e tempest-TestShelveInstance-2000558034 None] Deleting attachment cfe0ea68-c3a4-44e9-8d95-eebb59e8c11b. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:15:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Acquiring lock "cinder-0a10a316-2c8e-42dc-a127-b18f5b66df82-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Lock "cinder-0a10a316-2c8e-42dc-a127-b18f5b66df82-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Acquiring lock "cinder-quobyte-0a10a316-2c8e-42dc-a127-b18f5b66df82" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Lock "cinder-quobyte-0a10a316-2c8e-42dc-a127-b18f5b66df82" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:49 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f8d435-98ce-4f2a-9fc0-6b56d9fc7d69]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:49 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:15:49 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:50 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 0 in 0.972s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:50 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:15:50 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:51 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 1 in 1.030s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:15:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:51 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82 Jul 09 15:15:51 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:52 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0a10a316-2c8e-42dc-a127-b18f5b66df82" returned: 0 in 0.987s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Lock "cinder-quobyte-0a10a316-2c8e-42dc-a127-b18f5b66df82" released by "delete_volume" :: held 3.096s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:52 devstack cinder-volume[87042]: DEBUG cinder.quota [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Created reservations ['9fb7a54c-d3c6-4a20-99e4-ec308b280c56', '56d316fd-a321-4d3b-a072-8ac2d430b1b6', '72c93275-d5d6-4ebe-a781-63f82eb96215', 'f1a95171-2cc6-48a6-a9a6-dc020affa887'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:52 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:15:52 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:53 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.817s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:53 devstack cinder-volume[87042]: DEBUG cinder.manager [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:53 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Deleted volume successfully. Jul 09 15:15:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [req-15b5cfcf-6c75-41df-b173-bb950c441e97 req-bbc2a5c7-b20a-4a0f-9da5-da8ca7a64f55 tempest-TestShelveInstance-2000558034 None] Lock "cinder-0a10a316-2c8e-42dc-a127-b18f5b66df82-delete_volume" released by "delete_volume" :: held 4.287s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:02 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=102,cinder:SELECT=66,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:16:03 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=68,cinder:UPDATE=90,cinder:INSERT=18,cinder:DELETE=9 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:16:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:16:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:04 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:16:04 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:06 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.202s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:06 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:06 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:16:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:16:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:16:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-32e236ca-d9eb-43de-b521-930651b60694 tempest-VolumesActionsTest-1619489636 None] Acquiring lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5" by "attach_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-32e236ca-d9eb-43de-b521-930651b60694 tempest-VolumesActionsTest-1619489636 None] Lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5" acquired by "attach_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-32e236ca-d9eb-43de-b521-930651b60694 tempest-VolumesActionsTest-1619489636 None] Attaching volume 27709403-1355-4a58-a24d-68bebb4e1ac5 to instance 57b8208a-a3ac-4703-bc1c-2f8e271062e3 at mountpoint /dev/vdb on host None. Jul 09 15:16:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-32e236ca-d9eb-43de-b521-930651b60694 tempest-VolumesActionsTest-1619489636 None] Attach volume completed successfully. Jul 09 15:16:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-32e236ca-d9eb-43de-b521-930651b60694 tempest-VolumesActionsTest-1619489636 None] Lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5" released by "attach_volume" :: held 0.181s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9f62ee6-fe79-4f2f-978e-d3ac014fb02d tempest-VolumesActionsTest-1619489636 None] Acquiring lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5-detach_volume" by "detach_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9f62ee6-fe79-4f2f-978e-d3ac014fb02d tempest-VolumesActionsTest-1619489636 None] Lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:12 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b9f62ee6-fe79-4f2f-978e-d3ac014fb02d tempest-VolumesActionsTest-1619489636 None] Detaching volume 27709403-1355-4a58-a24d-68bebb4e1ac5 from instance 57b8208a-a3ac-4703-bc1c-2f8e271062e3. Jul 09 15:16:12 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b9f62ee6-fe79-4f2f-978e-d3ac014fb02d tempest-VolumesActionsTest-1619489636 None] Detach volume completed successfully. Jul 09 15:16:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9f62ee6-fe79-4f2f-978e-d3ac014fb02d tempest-VolumesActionsTest-1619489636 None] Lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:22 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:16:22 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (e330b3bf-5af9-4db2-817d-62dfb7c96ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84aaa47c-dc73-4961-9733-fcbf48ae778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84aaa47c-dc73-4961-9733-fcbf48ae778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1660708822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf565bb-d5af-4e3b-bbee-ef326e8849be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:29Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f95ab1-fab0-4d5d-b675-e45b4e93c2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f95ab1-fab0-4d5d-b675-e45b4e93c2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b953e04c-afb0-4364-933e-69e30ebf44b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b953e04c-afb0-4364-933e-69e30ebf44b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf565bb-d5af-4e3b-bbee-ef326e8849be', 'volume_name': 'volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93bdb8a-c20f-49b1-9c75-f2721b1149fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93bdb8a-c20f-49b1-9c75-f2721b1149fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1a196c-300e-4cef-beab-b5433c9c54be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:29 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Volume 4cf565bb-d5af-4e3b-bbee-ef326e8849be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be', 'volume_size': 1} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1660708822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf565bb-d5af-4e3b-bbee-ef326e8849be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:29Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Creating volume 4cf565bb-d5af-4e3b-bbee-ef326e8849be {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:29 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:16:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:29 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be 1073741824 Jul 09 15:16:29 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:31 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be 1073741824" returned: 0 in 1.762s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:31 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be Jul 09 15:16:31 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:32 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be" returned: 0 in 1.513s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] <== create_volume: return (3346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.349s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1a196c-300e-4cef-beab-b5433c9c54be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2f8858-8eeb-4f1c-89fe-e32b0184fa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:32 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Volume volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be (4cf565bb-d5af-4e3b-bbee-ef326e8849be): created successfully Jul 09 15:16:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2f8858-8eeb-4f1c-89fe-e32b0184fa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (e330b3bf-5af9-4db2-817d-62dfb7c96ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-74b8ff1d-d5ef-437e-861f-29fc56be5685 tempest-VolumesActionsTest-1208861355 None] Created volume successfully. Jul 09 15:16:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9026aae5-3398-4fb6-ac3c-a5b0c2ac9100 tempest-VolumesActionsTest-1208861355 None] Acquiring lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be" by "attach_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9026aae5-3398-4fb6-ac3c-a5b0c2ac9100 tempest-VolumesActionsTest-1208861355 None] Lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be" acquired by "attach_volume" :: waited 0.035s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9026aae5-3398-4fb6-ac3c-a5b0c2ac9100 tempest-VolumesActionsTest-1208861355 None] Attaching volume 4cf565bb-d5af-4e3b-bbee-ef326e8849be to instance 1fed1b39-572d-444e-8a86-dc88cebddf25 at mountpoint /dev/vdb on host None. Jul 09 15:16:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9026aae5-3398-4fb6-ac3c-a5b0c2ac9100 tempest-VolumesActionsTest-1208861355 None] Attach volume completed successfully. Jul 09 15:16:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9026aae5-3398-4fb6-ac3c-a5b0c2ac9100 tempest-VolumesActionsTest-1208861355 None] Lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be" released by "attach_volume" :: held 0.265s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ba9c46bd-74a1-48d7-9360-4e8d24bfc835 tempest-VolumesActionsTest-1341668002 None] Terminate volume connection completed successfully. Jul 09 15:16:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ba9c46bd-74a1-48d7-9360-4e8d24bfc835 tempest-VolumesActionsTest-1341668002 None] Acquiring lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be-detach_volume" by "detach_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ba9c46bd-74a1-48d7-9360-4e8d24bfc835 tempest-VolumesActionsTest-1341668002 None] Lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ba9c46bd-74a1-48d7-9360-4e8d24bfc835 tempest-VolumesActionsTest-1341668002 None] Detaching volume 4cf565bb-d5af-4e3b-bbee-ef326e8849be from instance 1fed1b39-572d-444e-8a86-dc88cebddf25. Jul 09 15:16:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ba9c46bd-74a1-48d7-9360-4e8d24bfc835 tempest-VolumesActionsTest-1341668002 None] Detach volume completed successfully. Jul 09 15:16:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ba9c46bd-74a1-48d7-9360-4e8d24bfc835 tempest-VolumesActionsTest-1341668002 None] Lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6af13253-5878-4721-8a48-09e96dce9d6e tempest-VolumesActionsTest-1208861355 None] Acquiring lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be-detach_volume" by "detach_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6af13253-5878-4721-8a48-09e96dce9d6e tempest-VolumesActionsTest-1208861355 None] Lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6af13253-5878-4721-8a48-09e96dce9d6e tempest-VolumesActionsTest-1208861355 None] Volume detach called, but volume not attached. Jul 09 15:16:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6af13253-5878-4721-8a48-09e96dce9d6e tempest-VolumesActionsTest-1208861355 None] Lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Acquiring lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Acquiring lock "cinder-quobyte-4cf565bb-d5af-4e3b-bbee-ef326e8849be" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Lock "cinder-quobyte-4cf565bb-d5af-4e3b-bbee-ef326e8849be" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:37 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b72dc4-753a-4b99-be9d-73e6a7fd8f63]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:37 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be Jul 09 15:16:37 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:39 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be" returned: 0 in 1.576s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:39 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be Jul 09 15:16:39 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:40 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4cf565bb-d5af-4e3b-bbee-ef326e8849be" returned: 0 in 0.805s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Lock "cinder-quobyte-4cf565bb-d5af-4e3b-bbee-ef326e8849be" released by "delete_volume" :: held 2.436s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:40 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Created reservations ['39cdb9f6-183a-4700-826c-b4b2494f23d5', 'e1f403d2-3e7a-4af6-b629-1790e16ef904', '6ac42fc3-1f95-4db1-8aa5-ab400a533748', '1f1a3c2f-7175-40dc-bf6f-4045c039c109'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:40 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:16:40 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:41 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.124s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:41 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Deleted volume successfully. Jul 09 15:16:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1a59a6d1-c40c-4d99-9d9d-361c57e54af1 tempest-VolumesActionsTest-1208861355 None] Lock "cinder-4cf565bb-d5af-4e3b-bbee-ef326e8849be-delete_volume" released by "delete_volume" :: held 3.869s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21f2dc70-0f09-4e3b-bc07-77f9f6ee8b5c tempest-VolumesActionsTest-1619489636 None] Acquiring lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5" by "attach_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21f2dc70-0f09-4e3b-bc07-77f9f6ee8b5c tempest-VolumesActionsTest-1619489636 None] Lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5" acquired by "attach_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:44 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-21f2dc70-0f09-4e3b-bc07-77f9f6ee8b5c tempest-VolumesActionsTest-1619489636 None] Attaching volume 27709403-1355-4a58-a24d-68bebb4e1ac5 to instance 7ffbb9ee-b540-414a-864b-80f5e85c3124 at mountpoint /dev/vdb on host None. Jul 09 15:16:44 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-21f2dc70-0f09-4e3b-bc07-77f9f6ee8b5c tempest-VolumesActionsTest-1619489636 None] Attach volume completed successfully. Jul 09 15:16:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21f2dc70-0f09-4e3b-bc07-77f9f6ee8b5c tempest-VolumesActionsTest-1619489636 None] Lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5" released by "attach_volume" :: held 0.162s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Acquiring lock "cinder-5ff0311d-ae3b-47ac-9914-a1b3f4b78794-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Lock "cinder-5ff0311d-ae3b-47ac-9914-a1b3f4b78794-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Acquiring lock "cinder-quobyte-5ff0311d-ae3b-47ac-9914-a1b3f4b78794" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Lock "cinder-quobyte-5ff0311d-ae3b-47ac-9914-a1b3f4b78794" acquired by "delete_volume" :: waited 0.044s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:44 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[af581e8f-9bf4-43b2-a51a-9242288cca6c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9b04cd95-9351-4fd5-8105-041b8a918bdb tempest-VolumesActionsTest-1619489636 None] Acquiring lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5-detach_volume" by "detach_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:45 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794 Jul 09 15:16:45 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9b04cd95-9351-4fd5-8105-041b8a918bdb tempest-VolumesActionsTest-1619489636 None] Lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9b04cd95-9351-4fd5-8105-041b8a918bdb tempest-VolumesActionsTest-1619489636 None] Detaching volume 27709403-1355-4a58-a24d-68bebb4e1ac5 from instance 7ffbb9ee-b540-414a-864b-80f5e85c3124. Jul 09 15:16:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9b04cd95-9351-4fd5-8105-041b8a918bdb tempest-VolumesActionsTest-1619489636 None] Detach volume completed successfully. Jul 09 15:16:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9b04cd95-9351-4fd5-8105-041b8a918bdb tempest-VolumesActionsTest-1619489636 None] Lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5-detach_volume" released by "detach_volume" :: held 0.136s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:45 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794" returned: 0 in 0.977s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:45 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794 Jul 09 15:16:45 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:46 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5ff0311d-ae3b-47ac-9914-a1b3f4b78794" returned: 0 in 1.074s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Lock "cinder-quobyte-5ff0311d-ae3b-47ac-9914-a1b3f4b78794" released by "delete_volume" :: held 2.177s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:47 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Created reservations ['f0cb1400-ab0f-4042-83f4-dfa593ce4f07', 'c016b716-95d2-42b5-82ba-398ae5124b05', 'f0316bab-1beb-4335-9397-185b248bc817', 'ef7e4ab2-8afd-4b24-b8cd-9f1d881138d5'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:47 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:16:47 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:48 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.933s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:48 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:48 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Deleted volume successfully. Jul 09 15:16:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-32cda747-c013-4e4c-a15d-19c09bb0dfff tempest-VolumesNegativeTest-19136828 None] Lock "cinder-5ff0311d-ae3b-47ac-9914-a1b3f4b78794-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (2a15e729-1a8b-4a4e-aba0-d2eb4bc596f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef687bfd-a55a-43f6-a5a7-3da7e3322aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef687bfd-a55a-43f6-a5a7-3da7e3322aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-478138732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf16aad-9840-4509-a4da-fba2134ca343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:49Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821223c5-aa7e-495c-9a45-01d286c9ec78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821223c5-aa7e-495c-9a45-01d286c9ec78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae592efc-6873-4d1b-95b8-5885b4515fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae592efc-6873-4d1b-95b8-5885b4515fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf16aad-9840-4509-a4da-fba2134ca343', 'volume_name': 'volume-3cf16aad-9840-4509-a4da-fba2134ca343', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d890ba-2ba7-400a-9374-4c119737f621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d890ba-2ba7-400a-9374-4c119737f621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a32f2c-aa24-498e-895c-dc0a86b901a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:49 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Volume 3cf16aad-9840-4509-a4da-fba2134ca343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf16aad-9840-4509-a4da-fba2134ca343', 'volume_size': 1} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-478138732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf16aad-9840-4509-a4da-fba2134ca343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:49Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Creating volume 3cf16aad-9840-4509-a4da-fba2134ca343 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:49 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:16:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:49 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343 1073741824 Jul 09 15:16:49 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:50 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343 1073741824" returned: 0 in 1.134s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:50 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343 Jul 09 15:16:50 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:51 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343" returned: 0 in 0.856s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a32f2c-aa24-498e-895c-dc0a86b901a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf16aad-9840-4509-a4da-fba2134ca343', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d3a43e-6987-4944-8a63-05bf02144ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:51 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Volume volume-3cf16aad-9840-4509-a4da-fba2134ca343 (3cf16aad-9840-4509-a4da-fba2134ca343): created successfully Jul 09 15:16:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d3a43e-6987-4944-8a63-05bf02144ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (2a15e729-1a8b-4a4e-aba0-d2eb4bc596f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:51 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c9725e7c-341a-49a3-91bc-6df6ed8d9fa2 tempest-VolumesActionsTest-1208861355 None] Created volume successfully. Jul 09 15:16:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Acquiring lock "cinder-3cf16aad-9840-4509-a4da-fba2134ca343-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Lock "cinder-3cf16aad-9840-4509-a4da-fba2134ca343-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Acquiring lock "cinder-quobyte-3cf16aad-9840-4509-a4da-fba2134ca343" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Lock "cinder-quobyte-3cf16aad-9840-4509-a4da-fba2134ca343" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:52 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b710227c-4ec4-4c15-b3a9-eedb3a237d9d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:53 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343 Jul 09 15:16:53 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:53 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343" returned: 0 in 1.011s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:54 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343 Jul 09 15:16:54 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:54 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3cf16aad-9840-4509-a4da-fba2134ca343" returned: 0 in 0.835s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Lock "cinder-quobyte-3cf16aad-9840-4509-a4da-fba2134ca343" released by "delete_volume" :: held 1.920s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:54 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Created reservations ['20906e6e-f6ad-4c11-ba54-7776ac928007', 'c5bc6cc6-d015-4336-b6cc-e3072b370c0a', '05f432e2-db31-4caa-9462-c6bb878e5512', '239385cc-f76d-4cf6-9c3c-f88c36647478'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87abc9a-ab65-4d2d-be2f-fded53edafad]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:55 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:55 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:55 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:16:55 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Flow 'volume_create_manager' (25d56322-da37-41d2-a338-f98c90b2b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df30f39d-1434-484e-bfdc-78c648261ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df30f39d-1434-484e-bfdc-78c648261ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1202171787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18781141-a144-4529-94f6-3ff4a253bc5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62aa339ce67d4e3885570575344f6358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:55Z,use_quota=True,user_id='7e93854768e74d56b4ad5bf28fb493de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84021712-c443-4fed-8ff0-f2cf244c9df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84021712-c443-4fed-8ff0-f2cf244c9df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6f5940-e093-4891-8dd1-85e4cdc42985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6f5940-e093-4891-8dd1-85e4cdc42985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18781141-a144-4529-94f6-3ff4a253bc5a', 'volume_name': 'volume-18781141-a144-4529-94f6-3ff4a253bc5a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b77847-31eb-4bf7-831d-1be590beb62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b77847-31eb-4bf7-831d-1be590beb62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ee40d8-16e0-4d31-8dcd-a1a13af3b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Volume 18781141-a144-4529-94f6-3ff4a253bc5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18781141-a144-4529-94f6-3ff4a253bc5a', 'volume_size': 1} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:55 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.801s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Deleted volume successfully. Jul 09 15:16:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7c30c59c-d938-4848-acb9-00885e58c84c tempest-VolumesActionsTest-1341668002 None] Lock "cinder-3cf16aad-9840-4509-a4da-fba2134ca343-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (0ab106cd-e3e8-4eb8-a799-56dd7feb5002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:56 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8dd914-d39f-481b-bcfd-bc0595ff4bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5" returned: 0 in 1.289s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8dd914-d39f-481b-bcfd-bc0595ff4bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1793776498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:56Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5cc798-d8db-42d9-afbf-25d0918dda76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5cc798-d8db-42d9-afbf-25d0918dda76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62207c3d-777e-486a-8afc-f79eaeaa2a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62207c3d-777e-486a-8afc-f79eaeaa2a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4', 'volume_name': 'volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87325ef9-43a8-41e8-91a3-82d41ba613f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87325ef9-43a8-41e8-91a3-82d41ba613f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538ec623-d861-40cd-ae08-85328e2c6020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:56 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Volume 7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4', 'volume_size': 1} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[36786f43-96c9-4c81-9542-f544febd3f1f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:56 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 Jul 09 15:16:56 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:57 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5" returned: 0 in 0.909s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.fa339cc6-f4d9-4280-96b1-8861189019ad556feygx.img {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:57 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.fa339cc6-f4d9-4280-96b1-8861189019ad556feygx.img Jul 09 15:16:57 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:03 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.fa339cc6-f4d9-4280-96b1-8861189019ad556feygx.img" returned: 0 in 6.191s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:03 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[73299598-6545-48c7-8c8d-098b45a2e47f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:03 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 Jul 09 15:17:03 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:04 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5" returned: 0 in 1.152s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:04 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.fa339cc6-f4d9-4280-96b1-8861189019ad556feygx.img {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:17:04 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Converted 1024.00 MB image at 165.35 MB/s Jul 09 15:17:04 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] fa339cc6-f4d9-4280-96b1-8861189019ad was raw, no need to convert to raw {{(pid=87042) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 15:17:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:17:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:04 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:17:04 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:05 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.891s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:17:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:17:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:17:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:17:14 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=34,cinder:UPDATE=38,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:17:14 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=37,cinder:SELECT=39,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Flow 'volume_create_manager' (ac8e5753-4037-41c3-9b66-fa33df6295a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c744c6a-2526-4f6d-90da-445b349ebbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c744c6a-2526-4f6d-90da-445b349ebbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1518403061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300aa0b6-584f-491c-aa73-2eb57f609ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2460477efd8b41d09e864f71be7b2225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:28Z,use_quota=True,user_id='518125e727b84490ab20be0d655e0657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08a3e5a2-ce7e-46ad-bc65-5eb0dd22d2c2),volume_type_id=08a3e5a2-ce7e-46ad-bc65-5eb0dd22d2c2)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ed579c-b363-4864-b1a7-99c37a721618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ed579c-b363-4864-b1a7-99c37a721618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6448d5-39b2-437a-9f1d-94cbb79913e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6448d5-39b2-437a-9f1d-94cbb79913e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300aa0b6-584f-491c-aa73-2eb57f609ad8', 'volume_name': 'volume-300aa0b6-584f-491c-aa73-2eb57f609ad8', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f0e9cc-4e18-439f-943e-a573889aa210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f0e9cc-4e18-439f-943e-a573889aa210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3806f5-0edb-4314-b7d3-f98ea894db3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:27 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Volume 300aa0b6-584f-491c-aa73-2eb57f609ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300aa0b6-584f-491c-aa73-2eb57f609ad8', 'volume_size': 1} Jul 09 15:17:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Flow 'volume_create_manager' (255c5de6-7cd5-4500-9b01-7ff42f98cd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d323a1-7255-4a1c-80d7-be8ba0985560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d323a1-7255-4a1c-80d7-be8ba0985560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-291646342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39514aef-5365-4068-a982-4321fc9e368b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2460477efd8b41d09e864f71be7b2225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:28Z,use_quota=True,user_id='518125e727b84490ab20be0d655e0657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1320bfe0-7e6e-4c42-9edd-d4d96babb75d),volume_type_id=1320bfe0-7e6e-4c42-9edd-d4d96babb75d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b481114f-6981-4790-95ab-4e219a546e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b481114f-6981-4790-95ab-4e219a546e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a627bfb7-88b0-43a0-953d-d01d2e5ecff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a627bfb7-88b0-43a0-953d-d01d2e5ecff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39514aef-5365-4068-a982-4321fc9e368b', 'volume_name': 'volume-39514aef-5365-4068-a982-4321fc9e368b', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20cd6ef-213d-4431-8b0e-a5edc7fb8fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20cd6ef-213d-4431-8b0e-a5edc7fb8fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a281b7cb-50f6-491c-a356-8a9d20b27172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:28 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Volume 39514aef-5365-4068-a982-4321fc9e368b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39514aef-5365-4068-a982-4321fc9e368b', 'volume_size': 1} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Flow 'volume_create_manager' (f04fc1d6-34a4-4585-a2eb-fff608ba8360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d8de48-e110-49cb-bd14-a484abb2f971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d8de48-e110-49cb-bd14-a484abb2f971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-447954363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4d6549-bf66-4cf9-a49b-6a43e11a901c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2460477efd8b41d09e864f71be7b2225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:29Z,use_quota=True,user_id='518125e727b84490ab20be0d655e0657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ca0a676-55f2-4d03-b99e-104244997305),volume_type_id=9ca0a676-55f2-4d03-b99e-104244997305)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ace2993-73a8-4cdf-8c5b-ece145fd934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ace2993-73a8-4cdf-8c5b-ece145fd934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013de94a-ab6a-466a-a536-8b6b6e3ca4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:28 devstack cinder-volume[87042]: DEBUG cinder.image.glance [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Creating Keystone auth plugin from conf {{(pid=87042) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:17:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013de94a-ab6a-466a-a536-8b6b6e3ca4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db4d6549-bf66-4cf9-a49b-6a43e11a901c', 'volume_name': 'volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c', 'volume_size': 1, 'image_id': '54741789-d233-4d15-b3e7-017a54ac1f80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54741789-d233-4d15-b3e7-017a54ac1f80', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1501343194', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2460477efd8b41d09e864f71be7b2225', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54741789-d233-4d15-b3e7-017a54ac1f80', 'created_at': datetime.datetime(2026, 7, 9, 13, 17, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54741789-d233-4d15-b3e7-017a54ac1f80/file', 'properties': {}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bbf895-0682-4c92-8e29-2de0e6d0b8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bbf895-0682-4c92-8e29-2de0e6d0b8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f189af53-9fae-4bdd-929e-ed8806de04f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:29 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Volume db4d6549-bf66-4cf9-a49b-6a43e11a901c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c', 'volume_size': 1, 'image_id': '54741789-d233-4d15-b3e7-017a54ac1f80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54741789-d233-4d15-b3e7-017a54ac1f80', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1501343194', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2460477efd8b41d09e864f71be7b2225', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54741789-d233-4d15-b3e7-017a54ac1f80', 'created_at': datetime.datetime(2026, 7, 9, 13, 17, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54741789-d233-4d15-b3e7-017a54ac1f80/file', 'properties': {}}, 'image_service': } Jul 09 15:17:29 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Trying to clone db4d6549-bf66-4cf9-a49b-6a43e11a901c from image 54741789-d233-4d15-b3e7-017a54ac1f80 at location (None, [{'url': 'file:///opt/stack/data/glance/images/54741789-d233-4d15-b3e7-017a54ac1f80', 'metadata': {}}]). {{(pid=87042) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.312s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Uploaded volume to glance image-id: fa339cc6-f4d9-4280-96b1-8861189019ad. {{(pid=87042) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 36.589s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1202171787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18781141-a144-4529-94f6-3ff4a253bc5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62aa339ce67d4e3885570575344f6358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:55Z,use_quota=True,user_id='7e93854768e74d56b4ad5bf28fb493de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Creating volume 18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:17:32 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:17:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:32 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a 1073741824 Jul 09 15:17:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-221cc9ab-1657-4eab-9019-36d8ee1167cc tempest-VolumesActionsTest-1619489636 None] Copy volume to image completed successfully. Jul 09 15:17:32 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:33 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD, size 20.69 MB, duration 3.93 sec {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:17:33 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Image download 20.69 MB at 5.26 MB/s Jul 09 15:17:33 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a 1073741824" returned: 0 in 1.056s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[977bd6ae-a3d6-4120-a392-c55f56568d37]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:33 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a Jul 09 15:17:33 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:33 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD Jul 09 15:17:33 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:34 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD" returned: 0 in 0.807s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Temporary image 54741789-d233-4d15-b3e7-017a54ac1f80 is fetched for user 518125e727b84490ab20be0d655e0657. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc778402-8f20-4cd9-9c7f-0af586a48729]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:34 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a" returned: 0 in 0.818s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 37.925s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1793776498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:56Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Creating volume 7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:17:34 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ee40d8-16e0-4d31-8dcd-a1a13af3b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18781141-a144-4529-94f6-3ff4a253bc5a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:34 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 1073741824 Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d93682-4070-4f3a-a7c1-54a46e0ba1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:34 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:34 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Volume volume-18781141-a144-4529-94f6-3ff4a253bc5a (18781141-a144-4529-94f6-3ff4a253bc5a): created successfully Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d93682-4070-4f3a-a7c1-54a46e0ba1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Flow 'volume_create_manager' (25d56322-da37-41d2-a338-f98c90b2b292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:34 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD Jul 09 15:17:34 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-eb0f0638-0528-400e-8d03-3aae5bba0bb0 tempest-TestStampPattern-1758697979 None] Created volume successfully. Jul 09 15:17:35 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD" returned: 0 in 0.843s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:35 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 1073741824" returned: 0 in 0.966s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:35 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 Jul 09 15:17:35 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:35 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4" returned: 0 in 0.695s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.100s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1518403061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300aa0b6-584f-491c-aa73-2eb57f609ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2460477efd8b41d09e864f71be7b2225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:28Z,use_quota=True,user_id='518125e727b84490ab20be0d655e0657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08a3e5a2-ce7e-46ad-bc65-5eb0dd22d2c2),volume_type_id=08a3e5a2-ce7e-46ad-bc65-5eb0dd22d2c2)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Creating volume 300aa0b6-584f-491c-aa73-2eb57f609ad8 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:17:35 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538ec623-d861-40cd-ae08-85328e2c6020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:35 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 1073741824 Jul 09 15:17:35 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e98b77-8f45-4cc1-b160-b8924b22cb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:36 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Volume volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 (7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4): created successfully Jul 09 15:17:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e98b77-8f45-4cc1-b160-b8924b22cb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (0ab106cd-e3e8-4eb8-a799-56dd7feb5002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-82cbfdcb-b835-4762-9ff1-ebad7f09418d tempest-VolumesActionsTest-1208861355 None] Created volume successfully. Jul 09 15:17:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Acquiring lock "cinder-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Lock "cinder-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Acquiring lock "cinder-quobyte-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Lock "cinder-quobyte-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4" acquired by "delete_volume" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:36 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[26572af3-9bb4-4f1a-a511-3fa0ebec42ae]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:36 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 Jul 09 15:17:36 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:36 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 1073741824" returned: 0 in 1.017s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:37 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 Jul 09 15:17:37 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:37 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4" returned: 0 in 0.879s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:37 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4 Jul 09 15:17:37 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:37 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8" returned: 0 in 0.724s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.614s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-291646342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39514aef-5365-4068-a982-4321fc9e368b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2460477efd8b41d09e864f71be7b2225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:28Z,use_quota=True,user_id='518125e727b84490ab20be0d655e0657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1320bfe0-7e6e-4c42-9edd-d4d96babb75d),volume_type_id=1320bfe0-7e6e-4c42-9edd-d4d96babb75d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Creating volume 39514aef-5365-4068-a982-4321fc9e368b {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:17:37 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:37 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b 1073741824 Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3806f5-0edb-4314-b7d3-f98ea894db3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300aa0b6-584f-491c-aa73-2eb57f609ad8', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:37 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db82477-d083-4297-bf43-e0e304787c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:38 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Volume volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 (300aa0b6-584f-491c-aa73-2eb57f609ad8): created successfully Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db82477-d083-4297-bf43-e0e304787c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Flow 'volume_create_manager' (ac8e5753-4037-41c3-9b66-fa33df6295a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:38 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-5219a83e-6a76-4049-b031-f87ef0fd6ad1 tempest-TestInstancesWithCinderVolumes-407364947 None] Created volume successfully. Jul 09 15:17:38 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4" returned: 0 in 0.680s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Lock "cinder-quobyte-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4" released by "delete_volume" :: held 1.604s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Created reservations ['340faa0e-d563-490e-ba6e-d963707e8b06', 'e826c54e-a3c6-4590-820d-a43872817231', 'e7df4231-4906-4604-868d-28de206004f9', 'f17b0be2-be79-4f01-8607-21cb8c3a548e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:38 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:17:38 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:38 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.734s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:17:38 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Deleted volume successfully. Jul 09 15:17:38 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b 1073741824" returned: 0 in 1.047s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e17a7235-c805-4475-9e23-d6ab1797cc90 tempest-VolumesActionsTest-1341668002 None] Lock "cinder-7bfc7b90-11ba-4eba-a603-94fcd7b2a0f4-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:39 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b Jul 09 15:17:39 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (a9aaa12d-54d3-4ec5-bcd8-6d268b00cf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7e2a08-6a58-4146-a131-5049eb371b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7e2a08-6a58-4146-a131-5049eb371b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1818856488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe338142-8938-4a9c-a247-da40c99ca317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:39Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ba0380-4e3d-47ed-9ffc-86ef87528e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ba0380-4e3d-47ed-9ffc-86ef87528e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3752e0-0a2b-43e2-99dd-e8c2825d4553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3752e0-0a2b-43e2-99dd-e8c2825d4553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe338142-8938-4a9c-a247-da40c99ca317', 'volume_name': 'volume-fe338142-8938-4a9c-a247-da40c99ca317', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09abb25-1034-4046-9608-9213c47c6665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09abb25-1034-4046-9608-9213c47c6665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c632fe89-748f-4c9b-bcc9-ed0dcdd70cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:39 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Volume fe338142-8938-4a9c-a247-da40c99ca317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe338142-8938-4a9c-a247-da40c99ca317', 'volume_size': 1} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:39 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b" returned: 0 in 0.669s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.732s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a281b7cb-50f6-491c-a356-8a9d20b27172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39514aef-5365-4068-a982-4321fc9e368b', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9856ea-e73d-41c0-adfb-0c5494f9c53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe43791d-d224-4c84-8027-bde3cda35aa6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:39 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Volume volume-39514aef-5365-4068-a982-4321fc9e368b (39514aef-5365-4068-a982-4321fc9e368b): created successfully Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9856ea-e73d-41c0-adfb-0c5494f9c53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Flow 'volume_create_manager' (255c5de6-7cd5-4500-9b01-7ff42f98cd1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:39 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2f61f90b-50fd-40ee-9852-912d8d810edd tempest-TestInstancesWithCinderVolumes-407364947 None] Created volume successfully. Jul 09 15:17:39 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 Jul 09 15:17:39 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-5d3aa27e-fad5-4c2e-9ad3-064f83da0962 req-c1bcecb2-95c5-4b5b-b322-a04d145b30c7 tempest-TestStampPattern-1758697979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:40 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5" returned: 0 in 0.781s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:40 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0815f4c-38f4-496e-94b9-89f905512182]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:40 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 Jul 09 15:17:40 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:41 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5" returned: 0 in 0.760s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:41 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img Jul 09 15:17:41 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:45 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img" returned: 0 in 4.522s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60379e1-f79c-48a3-aacf-a1ab545e6183]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:45 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 Jul 09 15:17:45 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:46 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5" returned: 0 in 0.906s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:46 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5, size 1024.00 MB, duration 4.52 sec, destination /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:17:46 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Converted 1024.00 MB image at 226.41 MB/s Jul 09 15:17:46 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] 151998b1-e30b-4122-90c5-ef059f3a7162 was raw, converting to qcow2 {{(pid=87042) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 15:17:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab9f395-57de-4ea2-997e-8048508336dc]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:46 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img Jul 09 15:17:46 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:47 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img" returned: 0 in 0.721s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:47 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img Jul 09 15:17:47 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:48 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img" returned: 1 in 0.715s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:17:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img /opt/stack/data/cinder/conversion/vol_upload_566hbvrr {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:48 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img /opt/stack/data/cinder/conversion/vol_upload_566hbvrr Jul 09 15:17:48 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:48 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img /opt/stack/data/cinder/conversion/vol_upload_566hbvrr" returned: 0 in 0.637s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:48 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Image conversion details: src /opt/stack/data/cinder/conversion/27709403-1355-4a58-a24d-68bebb4e1ac5.temp_image.151998b1-e30b-4122-90c5-ef059f3a7162g9d5b856.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_566hbvrr {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:17:48 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 09 15:17:48 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd6f892-8148-46c3-99b0-f2aca64f1105]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_566hbvrr {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:48 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_566hbvrr Jul 09 15:17:48 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:49 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_566hbvrr" returned: 0 in 0.709s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.064s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Uploaded volume to glance image-id: 151998b1-e30b-4122-90c5-ef059f3a7162. {{(pid=87042) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.717s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-447954363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4d6549-bf66-4cf9-a49b-6a43e11a901c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2460477efd8b41d09e864f71be7b2225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:29Z,use_quota=True,user_id='518125e727b84490ab20be0d655e0657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ca0a676-55f2-4d03-b99e-104244997305),volume_type_id=9ca0a676-55f2-4d03-b99e-104244997305)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Creating volume db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:17:50 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:17:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:50 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c 1073741824 Jul 09 15:17:50 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:50 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2ecab22f-129e-45a8-81bc-9383190ddacb tempest-VolumesActionsTest-1619489636 None] Copy volume to image completed successfully. Jul 09 15:17:51 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c 1073741824" returned: 0 in 0.835s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:51 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c Jul 09 15:17:51 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:52 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c" returned: 0 in 0.688s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.052s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1818856488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe338142-8938-4a9c-a247-da40c99ca317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:39Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Creating volume fe338142-8938-4a9c-a247-da40c99ca317 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:17:52 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Acquiring lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:52 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317 1073741824 Jul 09 15:17:52 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Attempting download of 54741789-d233-4d15-b3e7-017a54ac1f80 ((None, [{'url': 'file:///opt/stack/data/glance/images/54741789-d233-4d15-b3e7-017a54ac1f80', 'metadata': {}}])) to volume db4d6549-bf66-4cf9-a49b-6a43e11a901c. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Acquiring lock "cinder-quobyte-27709403-1355-4a58-a24d-68bebb4e1ac5" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afdfef7-fe95-43aa-8b69-53a70b3282d3]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54741789-d233-4d15-b3e7-017a54ac1f80_ogkkmcq7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Lock "cinder-quobyte-27709403-1355-4a58-a24d-68bebb4e1ac5" acquired by "delete_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b0d7e8-5264-431a-9c80-cfb280c0cddb]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:52 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54741789-d233-4d15-b3e7-017a54ac1f80_ogkkmcq7 Jul 09 15:17:52 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:52 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 Jul 09 15:17:52 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:53 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54741789-d233-4d15-b3e7-017a54ac1f80_ogkkmcq7" returned: 0 in 0.767s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54741789-d233-4d15-b3e7-017a54ac1f80_ogkkmcq7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:53 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317 1073741824" returned: 0 in 0.954s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:53 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5" returned: 0 in 0.808s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:53 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54741789-d233-4d15-b3e7-017a54ac1f80_ogkkmcq7 Jul 09 15:17:53 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:53 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5 Jul 09 15:17:53 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:53 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317 Jul 09 15:17:53 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:54 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54741789-d233-4d15-b3e7-017a54ac1f80_ogkkmcq7" returned: 1 in 0.794s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54741789-d233-4d15-b3e7-017a54ac1f80_ogkkmcq7' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[878c4a17-97c2-4dc7-a6f3-89b578daf885]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:54 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-27709403-1355-4a58-a24d-68bebb4e1ac5" returned: 0 in 0.724s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Lock "cinder-quobyte-27709403-1355-4a58-a24d-68bebb4e1ac5" released by "delete_volume" :: held 1.591s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:54 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317" returned: 0 in 0.744s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-5d3aa27e-fad5-4c2e-9ad3-064f83da0962 req-c1bcecb2-95c5-4b5b-b322-a04d145b30c7 tempest-TestStampPattern-1758697979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.752s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c632fe89-748f-4c9b-bcc9-ed0dcdd70cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe338142-8938-4a9c-a247-da40c99ca317', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16315832-ebc9-4af5-ac10-e4f077e83190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdfe420-0f5c-4ce6-a203-ed1e30373700]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-5d3aa27e-fad5-4c2e-9ad3-064f83da0962 req-c1bcecb2-95c5-4b5b-b322-a04d145b30c7 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:54 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Volume volume-fe338142-8938-4a9c-a247-da40c99ca317 (fe338142-8938-4a9c-a247-da40c99ca317): created successfully Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16315832-ebc9-4af5-ac10-e4f077e83190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:54 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD Jul 09 15:17:54 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (a9aaa12d-54d3-4ec5-bcd8-6d268b00cf75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:54 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d94cd5b7-0519-4da8-bcd9-f08d0f5e7adf tempest-VolumesActionsTest-1208861355 None] Created volume successfully. Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Created reservations ['4a9f24c2-8c45-4d14-801d-fcdfe9c9957d', '4fa1dbaf-6ff2-443c-88ea-f1fb51047089', 'dfc86225-a968-4aac-8f3e-d33a258db7ea', 'd5c4e727-0180-4e30-b861-6e03e35b9bee'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:54 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a Jul 09 15:17:54 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:54 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:17:54 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Acquiring lock "cinder-fe338142-8938-4a9c-a247-da40c99ca317-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Lock "cinder-fe338142-8938-4a9c-a247-da40c99ca317-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Acquiring lock "cinder-quobyte-fe338142-8938-4a9c-a247-da40c99ca317" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Lock "cinder-quobyte-fe338142-8938-4a9c-a247-da40c99ca317" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a216505-8498-41b3-8588-10b1d233ffec]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:54 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317 Jul 09 15:17:54 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:55 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD" returned: 0 in 0.951s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] 54741789-d233-4d15-b3e7-017a54ac1f80 was qcow2, converting to raw {{(pid=87042) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:55 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c Jul 09 15:17:55 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:55 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-5d3aa27e-fad5-4c2e-9ad3-064f83da0962 req-c1bcecb2-95c5-4b5b-b322-a04d145b30c7 tempest-TestStampPattern-1758697979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a" returned: 0 in 1.056s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-5d3aa27e-fad5-4c2e-9ad3-064f83da0962 req-c1bcecb2-95c5-4b5b-b322-a04d145b30c7 tempest-TestStampPattern-1758697979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.086s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:55 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.919s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:17:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Deleted volume successfully. Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-5d3aa27e-fad5-4c2e-9ad3-064f83da0962 req-c1bcecb2-95c5-4b5b-b322-a04d145b30c7 tempest-TestStampPattern-1758697979 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-18781141-a144-4529-94f6-3ff4a253bc5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05214d63-83d3-4e1c-a957-06c587b0f0ca', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-be0c7975-8a37-406e-8997-d8dd58f04961 tempest-VolumesActionsTest-1619489636 None] Lock "cinder-27709403-1355-4a58-a24d-68bebb4e1ac5-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-5d3aa27e-fad5-4c2e-9ad3-064f83da0962 req-c1bcecb2-95c5-4b5b-b322-a04d145b30c7 tempest-TestStampPattern-1758697979 None] attachment_update completed successfully. Jul 09 15:17:55 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317" returned: 0 in 1.158s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:55 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317 Jul 09 15:17:55 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:56 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-fe338142-8938-4a9c-a247-da40c99ca317" returned: 0 in 0.788s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Lock "cinder-quobyte-fe338142-8938-4a9c-a247-da40c99ca317" released by "delete_volume" :: held 2.031s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:56 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Created reservations ['8ef3140a-61d4-4531-9453-1ef3f3b574ff', '7b25b08b-0660-4a4e-a8af-66b6d8c2b27c', '43d404b6-02eb-49fe-80d8-de1a90fa6eea', '87b371cf-d576-47ce-994c-af3b2a29d8e8'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:56 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:17:56 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:57 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c" returned: 0 in 2.416s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:57 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54741789-d233-4d15-b3e7-017a54ac1f80_d_9wv883devstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:17:57 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Converted 112.00 MB image at 46.30 MB/s Jul 09 15:17:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:57 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c 1G Jul 09 15:17:57 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:57 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.678s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:57 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:17:57 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Deleted volume successfully. Jul 09 15:17:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8b51a516-ca2a-4e3b-9359-ae3b4e4ab5cd tempest-VolumesActionsTest-1341668002 None] Lock "cinder-fe338142-8938-4a9c-a247-da40c99ca317-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:58 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c 1G" returned: 0 in 0.945s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[deffba18-7439-4e0b-9bfc-754c484fd5a1]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:58 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c Jul 09 15:17:58 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (d497e31a-8eee-4ffa-ae35-3c5ab612c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e55f2d-7c36-4558-9d51-fc4434d2f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e55f2d-7c36-4558-9d51-fc4434d2f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-465861038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b34af2-3090-442c-8d19-002f39b7c866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:59Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5f8a18-0640-46e5-8cd4-4184f245f089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5f8a18-0640-46e5-8cd4-4184f245f089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f746ad2-13cf-4189-9847-b6911aa66793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f746ad2-13cf-4189-9847-b6911aa66793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b34af2-3090-442c-8d19-002f39b7c866', 'volume_name': 'volume-74b34af2-3090-442c-8d19-002f39b7c866', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586f118d-3d05-437b-86cd-c8d9fd865f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586f118d-3d05-437b-86cd-c8d9fd865f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1175b042-b0a3-4f78-96cf-32942073ef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:58 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Volume 74b34af2-3090-442c-8d19-002f39b7c866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b34af2-3090-442c-8d19-002f39b7c866', 'volume_size': 1} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-465861038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b34af2-3090-442c-8d19-002f39b7c866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:59Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Creating volume 74b34af2-3090-442c-8d19-002f39b7c866 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:17:58 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:17:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:58 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866 1073741824 Jul 09 15:17:58 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:59 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c" returned: 0 in 0.955s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:59 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c Jul 09 15:17:59 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:59 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866 1073741824" returned: 0 in 1.066s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:59 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866 Jul 09 15:17:59 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:00 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c" returned: 1 in 1.075s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Downloaded image 54741789-d233-4d15-b3e7-017a54ac1f80 ((None, [{'url': 'file:///opt/stack/data/glance/images/54741789-d233-4d15-b3e7-017a54ac1f80', 'metadata': {}}])) to volume db4d6549-bf66-4cf9-a49b-6a43e11a901c successfully. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Temporary image 54741789-d233-4d15-b3e7-017a54ac1f80 for user 518125e727b84490ab20be0d655e0657 is deleted. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Marking volume db4d6549-bf66-4cf9-a49b-6a43e11a901c as bootable. {{(pid=87042) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Copying metadata from image 54741789-d233-4d15-b3e7-017a54ac1f80 to db4d6549-bf66-4cf9-a49b-6a43e11a901c. {{(pid=87042) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Creating volume glance metadata for volume db4d6549-bf66-4cf9-a49b-6a43e11a901c backed by image 54741789-d233-4d15-b3e7-017a54ac1f80 with: {'image_id': '54741789-d233-4d15-b3e7-017a54ac1f80', 'image_name': 'tempest-scenario-img--1501343194', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87042) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:18:00 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866" returned: 0 in 0.793s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f189af53-9fae-4bdd-929e-ed8806de04f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c', 'volume_size': 1, 'image_id': '54741789-d233-4d15-b3e7-017a54ac1f80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54741789-d233-4d15-b3e7-017a54ac1f80', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1501343194', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2460477efd8b41d09e864f71be7b2225', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54741789-d233-4d15-b3e7-017a54ac1f80', 'created_at': datetime.datetime(2026, 7, 9, 13, 17, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54741789-d233-4d15-b3e7-017a54ac1f80/file', 'properties': {}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afeec30-a40a-4231-92bf-27ffe6fe78ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1175b042-b0a3-4f78-96cf-32942073ef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b34af2-3090-442c-8d19-002f39b7c866', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e694e596-0918-452f-bd0b-f9d3a1cc667d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:00 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Volume volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c (db4d6549-bf66-4cf9-a49b-6a43e11a901c): created successfully Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afeec30-a40a-4231-92bf-27ffe6fe78ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Flow 'volume_create_manager' (f04fc1d6-34a4-4585-a2eb-fff608ba8360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:00 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Volume volume-74b34af2-3090-442c-8d19-002f39b7c866 (74b34af2-3090-442c-8d19-002f39b7c866): created successfully Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e694e596-0918-452f-bd0b-f9d3a1cc667d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (d497e31a-8eee-4ffa-ae35-3c5ab612c647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:00 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6f15d647-5f63-425f-a574-8513e426076b tempest-TestInstancesWithCinderVolumes-407364947 None] Created volume successfully. Jul 09 15:18:00 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6f03c660-e0ba-4fb7-b2aa-2ce06d4bb0bb tempest-VolumesActionsTest-1208861355 None] Created volume successfully. Jul 09 15:18:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Acquiring lock "cinder-74b34af2-3090-442c-8d19-002f39b7c866-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Lock "cinder-74b34af2-3090-442c-8d19-002f39b7c866-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Acquiring lock "cinder-quobyte-74b34af2-3090-442c-8d19-002f39b7c866" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Lock "cinder-quobyte-74b34af2-3090-442c-8d19-002f39b7c866" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaeda13-14b0-4b7d-8a5f-a8c6d2fe642e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:02 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866 Jul 09 15:18:02 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Flow 'volume_create_manager' (c6a3f197-c0bb-4fae-83c3-1b4017314089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ce9426-beed-4801-9f48-3e6c6387799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ce9426-beed-4801-9f48-3e6c6387799d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1752192900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9511b531-441c-457e-9783-68c6aa0b335c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='665a39eff22f4dd99d798921e7674bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:03Z,use_quota=True,user_id='bb6b13f79ce249f7994c560fad59cced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c259c5e9-2369-4661-84a5-a1d1a16f6489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c259c5e9-2369-4661-84a5-a1d1a16f6489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d3bcb0-1073-49eb-93a5-f983ad724ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d3bcb0-1073-49eb-93a5-f983ad724ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9511b531-441c-457e-9783-68c6aa0b335c', 'volume_name': 'volume-9511b531-441c-457e-9783-68c6aa0b335c', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2858c4-1a86-4fb8-8108-b5475945fd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2858c4-1a86-4fb8-8108-b5475945fd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37dac1a9-a95f-4aa5-ad08-7db2540773a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:02 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Volume 9511b531-441c-457e-9783-68c6aa0b335c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9511b531-441c-457e-9783-68c6aa0b335c', 'volume_size': 1} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1752192900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9511b531-441c-457e-9783-68c6aa0b335c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='665a39eff22f4dd99d798921e7674bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:03Z,use_quota=True,user_id='bb6b13f79ce249f7994c560fad59cced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Creating volume 9511b531-441c-457e-9783-68c6aa0b335c {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:02 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:18:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:02 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c 1073741824 Jul 09 15:18:02 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:03 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866" returned: 0 in 1.216s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:03 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866 Jul 09 15:18:03 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:03 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c 1073741824" returned: 0 in 1.012s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:03 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c Jul 09 15:18:03 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:04 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-74b34af2-3090-442c-8d19-002f39b7c866" returned: 0 in 0.710s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Lock "cinder-quobyte-74b34af2-3090-442c-8d19-002f39b7c866" released by "delete_volume" :: held 1.983s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Created reservations ['3c267e9e-64ac-488f-98ce-ea0fc2ee16d0', 'fa743774-b47a-4078-bb3d-a9ae6ed0dcbe', '09c950aa-42de-4926-8906-097205ce3330', '95724777-5c3b-4cf8-a4b5-425ce73b508d'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:04 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:18:04 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:04 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-114ba39d-e070-4802-a646-0fc7de620b60 req-4c951f23-2330-42b9-a153-8da8709c080b tempest-TestStampPattern-1758697979 None] Terminate volume connection completed successfully. Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-114ba39d-e070-4802-a646-0fc7de620b60 req-4c951f23-2330-42b9-a153-8da8709c080b tempest-TestStampPattern-1758697979 None] Deleting attachment 05214d63-83d3-4e1c-a957-06c587b0f0ca. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:18:04 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c" returned: 0 in 0.970s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37dac1a9-a95f-4aa5-ad08-7db2540773a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9511b531-441c-457e-9783-68c6aa0b335c', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a760cecf-d4af-4e69-8f8b-ec6e658af663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:04 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Volume volume-9511b531-441c-457e-9783-68c6aa0b335c (9511b531-441c-457e-9783-68c6aa0b335c): created successfully Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a760cecf-d4af-4e69-8f8b-ec6e658af663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:04 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:18:04 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Flow 'volume_create_manager' (c6a3f197-c0bb-4fae-83c3-1b4017314089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:04 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6baf86f8-b4a9-4dd7-b228-a7b77e9de841 tempest-VolumesListTestJSON-1509139190 None] Created volume successfully. Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (df8646a0-750b-42cd-8b71-6f6822b63f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4576f6-8540-457d-8501-3c4cd4cb1734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:05 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4576f6-8540-457d-8501-3c4cd4cb1734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-544288195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6f2954-ee4c-4e83-9d22-28ab5f82d452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:05Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e9cee2-6bdd-4c7b-886d-7cb5ecf6fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e9cee2-6bdd-4c7b-886d-7cb5ecf6fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba3063e-5351-4b19-98c2-1f8905872739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba3063e-5351-4b19-98c2-1f8905872739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6f2954-ee4c-4e83-9d22-28ab5f82d452', 'volume_name': 'volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9ab729-a82d-4a52-932d-565eb227a1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9ab729-a82d-4a52-932d-565eb227a1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261b5209-38c3-436c-b2f4-0606d16d4525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:05 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Volume ae6f2954-ee4c-4e83-9d22-28ab5f82d452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452', 'volume_size': 1} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-544288195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6f2954-ee4c-4e83-9d22-28ab5f82d452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867de1b2d76e43768204bcdfab9f9f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:05Z,use_quota=True,user_id='ca28a055148f43e79cf61e6afbfdf65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Creating volume ae6f2954-ee4c-4e83-9d22-28ab5f82d452 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:05 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.926s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:05 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Deleted volume successfully. Jul 09 15:18:05 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452 1073741824 Jul 09 15:18:05 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d594d258-afcb-49ba-80bd-44c8b87899bf tempest-VolumesActionsTest-1341668002 None] Lock "cinder-74b34af2-3090-442c-8d19-002f39b7c866-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:05 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.841s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:18:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:18:06 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452 1073741824" returned: 0 in 1.040s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:06 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452 Jul 09 15:18:06 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Flow 'volume_create_manager' (0c7ef079-0461-4d34-b4a9-71741c02beef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f664ff-729e-4bc4-8659-a6c918405ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f664ff-729e-4bc4-8659-a6c918405ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-635360680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffccbf9d-c713-4bbf-9fc9-60e3c1333477,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='665a39eff22f4dd99d798921e7674bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:06Z,use_quota=True,user_id='bb6b13f79ce249f7994c560fad59cced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d74ef9e-fd2b-4814-a1df-81dd88791068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d74ef9e-fd2b-4814-a1df-81dd88791068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedd94a4-f645-4e33-b89c-84b37884a83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedd94a4-f645-4e33-b89c-84b37884a83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffccbf9d-c713-4bbf-9fc9-60e3c1333477', 'volume_name': 'volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc4b001-8398-4261-9102-77afec5b9d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc4b001-8398-4261-9102-77afec5b9d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c9c12e-36b8-46ce-80a7-f55ce35bb375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:06 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Volume ffccbf9d-c713-4bbf-9fc9-60e3c1333477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477', 'volume_size': 1} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:07 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452" returned: 0 in 0.698s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-635360680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffccbf9d-c713-4bbf-9fc9-60e3c1333477,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='665a39eff22f4dd99d798921e7674bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:06Z,use_quota=True,user_id='bb6b13f79ce249f7994c560fad59cced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Creating volume ffccbf9d-c713-4bbf-9fc9-60e3c1333477 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:07 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:07 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477 1073741824 Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261b5209-38c3-436c-b2f4-0606d16d4525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:07 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab98dab2-d1e1-4fac-a804-6ab01d128c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:07 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Volume volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452 (ae6f2954-ee4c-4e83-9d22-28ab5f82d452): created successfully Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab98dab2-d1e1-4fac-a804-6ab01d128c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Flow 'volume_create_manager' (df8646a0-750b-42cd-8b71-6f6822b63f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:07 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-5587863a-13b6-432c-a7ec-0eefb6c4680f tempest-VolumesActionsTest-1208861355 None] Created volume successfully. Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Acquiring lock "cinder-ae6f2954-ee4c-4e83-9d22-28ab5f82d452-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Lock "cinder-ae6f2954-ee4c-4e83-9d22-28ab5f82d452-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Acquiring lock "cinder-quobyte-ae6f2954-ee4c-4e83-9d22-28ab5f82d452" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Lock "cinder-quobyte-ae6f2954-ee4c-4e83-9d22-28ab5f82d452" acquired by "delete_volume" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:07 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477 1073741824" returned: 0 in 0.902s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a33a7a-8af5-4437-adeb-7347bf1b0315]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:08 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477 Jul 09 15:18:08 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:08 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452 Jul 09 15:18:08 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:08 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477" returned: 0 in 0.706s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.718s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Creating offline snapshot 7cb8338a-23e1-499a-a780-f5f7f084094f of volume 18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c9c12e-36b8-46ce-80a7-f55ce35bb375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03572c67-d9ad-4cc9-9f5f-daefeb8461f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2bfc26-0208-499f-8785-711778d5cbb3]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:08 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Volume volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477 (ffccbf9d-c713-4bbf-9fc9-60e3c1333477): created successfully Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03572c67-d9ad-4cc9-9f5f-daefeb8461f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Flow 'volume_create_manager' (0c7ef079-0461-4d34-b4a9-71741c02beef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:08 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452" returned: 0 in 0.841s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:08 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-36225724-4fcc-44ff-ae27-7b65fb4694ca tempest-VolumesListTestJSON-1509139190 None] Created volume successfully. Jul 09 15:18:08 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452 Jul 09 15:18:08 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:08 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a Jul 09 15:18:08 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:09 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:09 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ae6f2954-ee4c-4e83-9d22-28ab5f82d452" returned: 0 in 1.048s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a" returned: 0 in 1.105s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Lock "cinder-quobyte-ae6f2954-ee4c-4e83-9d22-28ab5f82d452" released by "delete_volume" :: held 1.973s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:09 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f 1G Jul 09 15:18:09 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Created reservations ['433479c4-19cc-42c6-a9ef-d22f03062ea3', '43a63e6b-8946-4aea-9e8b-a719f508eafd', '86f448e0-7d5a-46b9-95ec-0cc88c1c93ca', '45019034-c581-46b4-8bda-fc1b70e43e5d'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-89c9c6b0-2edf-4623-8bf7-926eecaf6232 req-63ab3f78-0522-49b9-b9bf-2eebc0c810b8 tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:10 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:18:10 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Flow 'volume_create_manager' (e0bab115-a423-4981-9a8c-ebf97b1b2e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d433b13b-41d7-4705-90d3-94c859a6e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d433b13b-41d7-4705-90d3-94c859a6e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-34386714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1829ce77-87e6-4c00-80a9-5fa262f8c748,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='665a39eff22f4dd99d798921e7674bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:11Z,use_quota=True,user_id='bb6b13f79ce249f7994c560fad59cced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730c3f84-7ead-4014-a8f2-940e68d40127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730c3f84-7ead-4014-a8f2-940e68d40127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243dd6bc-7745-4300-bfeb-a87a49211e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243dd6bc-7745-4300-bfeb-a87a49211e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1829ce77-87e6-4c00-80a9-5fa262f8c748', 'volume_name': 'volume-1829ce77-87e6-4c00-80a9-5fa262f8c748', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0276260-5f0e-4035-b0f6-ea20c84c17a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0276260-5f0e-4035-b0f6-ea20c84c17a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277ab168-32e8-47b4-b471-ce5c5961c3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:10 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Volume 1829ce77-87e6-4c00-80a9-5fa262f8c748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1829ce77-87e6-4c00-80a9-5fa262f8c748', 'volume_size': 1} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:10 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f 1G" returned: 0 in 1.076s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18781141-a144-4529-94f6-3ff4a253bc5a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:10 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18781141-a144-4529-94f6-3ff4a253bc5a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f Jul 09 15:18:10 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:11 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.882s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:11 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Deleted volume successfully. Jul 09 15:18:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8a7457b2-93fc-4d5a-98c2-b7ec30f7199c tempest-VolumesActionsTest-1208861355 None] Lock "cinder-ae6f2954-ee4c-4e83-9d22-28ab5f82d452-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:11 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18781141-a144-4529-94f6-3ff4a253bc5a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f" returned: 0 in 0.789s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:11 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f is being set with open permissions: ugo+rw Jul 09 15:18:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:11 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f Jul 09 15:18:11 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:12 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f" returned: 0 in 0.719s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:12 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.info Jul 09 15:18:12 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:13 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.info" returned: 0 in 0.691s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:13 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.info is being set with open permissions: ugo+rw Jul 09 15:18:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:13 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.info Jul 09 15:18:13 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:13 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.info" returned: 0 in 0.771s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.262s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-89c9c6b0-2edf-4623-8bf7-926eecaf6232 req-63ab3f78-0522-49b9-b9bf-2eebc0c810b8 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.681s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ccffb9e1-c43c-498a-89f6-44718d385d9c tempest-TestStampPattern-1758697979 None] Create snapshot completed successfully Jul 09 15:18:14 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0b4349-5643-4146-8143-1ccd7bbee1d5]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-89c9c6b0-2edf-4623-8bf7-926eecaf6232 req-63ab3f78-0522-49b9-b9bf-2eebc0c810b8 tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:14 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c Jul 09 15:18:14 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:14 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-89c9c6b0-2edf-4623-8bf7-926eecaf6232 req-63ab3f78-0522-49b9-b9bf-2eebc0c810b8 tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c" returned: 0 in 0.909s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-89c9c6b0-2edf-4623-8bf7-926eecaf6232 req-63ab3f78-0522-49b9-b9bf-2eebc0c810b8 tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:15 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c Jul 09 15:18:15 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:15 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-89c9c6b0-2edf-4623-8bf7-926eecaf6232 req-63ab3f78-0522-49b9-b9bf-2eebc0c810b8 tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c" returned: 1 in 0.851s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-89c9c6b0-2edf-4623-8bf7-926eecaf6232 req-63ab3f78-0522-49b9-b9bf-2eebc0c810b8 tempest-TestInstancesWithCinderVolumes-407364947 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-89c9c6b0-2edf-4623-8bf7-926eecaf6232 req-63ab3f78-0522-49b9-b9bf-2eebc0c810b8 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.816s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.072s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-34386714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1829ce77-87e6-4c00-80a9-5fa262f8c748,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='665a39eff22f4dd99d798921e7674bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:11Z,use_quota=True,user_id='bb6b13f79ce249f7994c560fad59cced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Creating volume 1829ce77-87e6-4c00-80a9-5fa262f8c748 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:15 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:15 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748 1073741824 Jul 09 15:18:15 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:15 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-89c9c6b0-2edf-4623-8bf7-926eecaf6232 req-63ab3f78-0522-49b9-b9bf-2eebc0c810b8 tempest-TestInstancesWithCinderVolumes-407364947 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ead2cd79-3b56-42f5-ab6f-0d2b8b750cd8', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:18:15 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-89c9c6b0-2edf-4623-8bf7-926eecaf6232 req-63ab3f78-0522-49b9-b9bf-2eebc0c810b8 tempest-TestInstancesWithCinderVolumes-407364947 None] attachment_update completed successfully. Jul 09 15:18:16 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748 1073741824" returned: 0 in 0.933s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:16 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748 Jul 09 15:18:16 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:17 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748" returned: 0 in 0.753s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277ab168-32e8-47b4-b471-ce5c5961c3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1829ce77-87e6-4c00-80a9-5fa262f8c748', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e7c562-1042-41f3-bbdf-391516246370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:17 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Volume volume-1829ce77-87e6-4c00-80a9-5fa262f8c748 (1829ce77-87e6-4c00-80a9-5fa262f8c748): created successfully Jul 09 15:18:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e7c562-1042-41f3-bbdf-391516246370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Flow 'volume_create_manager' (e0bab115-a423-4981-9a8c-ebf97b1b2e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:17 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-cd8d2656-c9ce-417b-ac73-16c2f115ec74 tempest-VolumesListTestJSON-1509139190 None] Created volume successfully. Jul 09 15:18:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "cinder-1829ce77-87e6-4c00-80a9-5fa262f8c748-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-1829ce77-87e6-4c00-80a9-5fa262f8c748-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "cinder-quobyte-1829ce77-87e6-4c00-80a9-5fa262f8c748" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-quobyte-1829ce77-87e6-4c00-80a9-5fa262f8c748" acquired by "delete_volume" :: waited 0.037s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:21 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91105fa-67ae-489b-baba-7dc831e93881]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:21 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748 Jul 09 15:18:21 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:22 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748" returned: 0 in 1.160s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:22 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748 Jul 09 15:18:22 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:23 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-1829ce77-87e6-4c00-80a9-5fa262f8c748" returned: 0 in 1.098s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-quobyte-1829ce77-87e6-4c00-80a9-5fa262f8c748" released by "delete_volume" :: held 2.340s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:23 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Created reservations ['24f9ae6f-6e4b-47cf-a273-42b640bba3fa', 'ce466fb5-bcf4-4ef9-866e-4e65afc85d34', '3c821d52-dd9a-427f-b99e-330be27be694', '9fc026da-d7c8-44b7-bddc-2de8689a32da'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:23 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:18:23 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "cinder-ffccbf9d-c713-4bbf-9fc9-60e3c1333477-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-ffccbf9d-c713-4bbf-9fc9-60e3c1333477-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:24 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=77,cinder:UPDATE=98,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:18:25 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=72,cinder:UPDATE=78,cinder:INSERT=21,cinder:DELETE=8 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:18:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "cinder-quobyte-ffccbf9d-c713-4bbf-9fc9-60e3c1333477" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-quobyte-ffccbf9d-c713-4bbf-9fc9-60e3c1333477" acquired by "delete_volume" :: waited 0.037s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:25 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b7db39-0bde-4b83-baa0-799cf3fd33ac]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:25 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.548s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:25 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Deleted volume successfully. Jul 09 15:18:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-95b8ebfc-0b49-48a4-aae4-5ee57e82dce9 tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-1829ce77-87e6-4c00-80a9-5fa262f8c748-delete_volume" released by "delete_volume" :: held 4.334s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:25 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477 Jul 09 15:18:25 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:27 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477" returned: 0 in 1.917s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:27 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477 Jul 09 15:18:27 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Flow 'volume_create_manager' (839fffa6-059b-48d7-9f28-e1b53e088007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467c1499-ed91-466c-adf0-9913123b9511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467c1499-ed91-466c-adf0-9913123b9511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1890910611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339e9bf0-c8f7-470b-a26f-3560843225ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62aa339ce67d4e3885570575344f6358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7cb8338a-23e1-499a-a780-f5f7f084094f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:28Z,use_quota=True,user_id='7e93854768e74d56b4ad5bf28fb493de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f7d71b-f3c1-49c6-bb0c-458b5afdda69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f7d71b-f3c1-49c6-bb0c-458b5afdda69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1948d3b-4672-41d5-b425-a9115a89c00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1948d3b-4672-41d5-b425-a9115a89c00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '339e9bf0-c8f7-470b-a26f-3560843225ec', 'volume_name': 'volume-339e9bf0-c8f7-470b-a26f-3560843225ec', 'volume_size': 1, 'snapshot_id': '7cb8338a-23e1-499a-a780-f5f7f084094f'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8730e4-466f-4e44-8a58-2ca704de6cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8730e4-466f-4e44-8a58-2ca704de6cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54721282-ea56-4172-a9fb-5858d8722370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:27 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Volume 339e9bf0-c8f7-470b-a26f-3560843225ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-339e9bf0-c8f7-470b-a26f-3560843225ec', 'volume_size': 1, 'snapshot_id': '7cb8338a-23e1-499a-a780-f5f7f084094f'} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Acquiring lock "cinder-quobyte-7cb8338a-23e1-499a-a780-f5f7f084094f-339e9bf0-c8f7-470b-a26f-3560843225ec" by "_create_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-7cb8338a-23e1-499a-a780-f5f7f084094f-339e9bf0-c8f7-470b-a26f-3560843225ec" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Creating volume 339e9bf0-c8f7-470b-a26f-3560843225ec from snapshot 7cb8338a-23e1-499a-a780-f5f7f084094f {{(pid=87042) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Acquiring lock "cinder-quobyte-339e9bf0-c8f7-470b-a26f-3560843225ec" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-339e9bf0-c8f7-470b-a26f-3560843225ec" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] snapshot: 7cb8338a-23e1-499a-a780-f5f7f084094f, volume: 339e9bf0-c8f7-470b-a26f-3560843225ec, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52d6230-6689-404f-aff2-767d8c6d4758]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:28 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-ffccbf9d-c713-4bbf-9fc9-60e3c1333477" returned: 0 in 1.218s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-quobyte-ffccbf9d-c713-4bbf-9fc9-60e3c1333477" released by "delete_volume" :: held 3.245s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:28 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f Jul 09 15:18:28 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Created reservations ['d303a905-6071-47f6-afc0-c1cb3152f6e6', '6b545c52-53cc-4f77-a8ee-d16f8987a67a', '4a5c8c56-0af1-4ff9-843a-00917ee06702', '89cc8b7e-7653-42dd-a8d4-3193ffb64e0a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:28 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:18:28 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "cinder-9511b531-441c-457e-9783-68c6aa0b335c-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-9511b531-441c-457e-9783-68c6aa0b335c-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "cinder-quobyte-9511b531-441c-457e-9783-68c6aa0b335c" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-quobyte-9511b531-441c-457e-9783-68c6aa0b335c" acquired by "delete_volume" :: waited 0.039s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:30 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f" returned: 0 in 2.030s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18781141-a144-4529-94f6-3ff4a253bc5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e367dc-7163-4811-9522-47e44a310c79]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:30 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6752f5-58a8-469a-b1cf-4e5042c98bdf]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.546s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:30 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Deleted volume successfully. Jul 09 15:18:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07a48f26-3cdc-4f6b-ba85-d288dcfa331c tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-ffccbf9d-c713-4bbf-9fc9-60e3c1333477-delete_volume" released by "delete_volume" :: held 5.360s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:30 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c Jul 09 15:18:30 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:30 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a Jul 09 15:18:30 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:31 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c" returned: 0 in 1.684s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:31 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c Jul 09 15:18:31 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:32 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a" returned: 0 in 1.877s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:32 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:18:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:32 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec Jul 09 15:18:32 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:33 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9511b531-441c-457e-9783-68c6aa0b335c" returned: 0 in 1.119s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-quobyte-9511b531-441c-457e-9783-68c6aa0b335c" released by "delete_volume" :: held 2.991s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:33 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Created reservations ['6a269a03-eae8-4c47-958b-ec5baf5b7368', '87ecd213-dfb7-4427-b4f7-2f704ae9f89f', '2d0032c6-8700-4aa7-b959-511cb113637f', 'e651c6a2-3c19-454c-9d31-4a4b8abe8170'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:33 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:18:33 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:35 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 2.268s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:35 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Deleted volume successfully. Jul 09 15:18:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c26cae2-48de-4b00-a760-544aab5717ae tempest-VolumesListTestJSON-1509139190 None] Lock "cinder-9511b531-441c-457e-9783-68c6aa0b335c-delete_volume" released by "delete_volume" :: held 5.832s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:38 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Flow 'volume_create_manager' (be9f3dc1-8b4f-46a3-9be6-4b309bc92144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0377c4-bd2d-4d5d-88f4-0627272b553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0377c4-bd2d-4d5d-88f4-0627272b553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-606145437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcca8a7-2452-4ba3-b2ef-4c3a6764f974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff1dad2237d46199d9e5c016ab6d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:39Z,use_quota=True,user_id='53b71043da3e447ba60d6e43d9bc984c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e924c1b5-648c-4ef6-83ae-727342b7a1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e924c1b5-648c-4ef6-83ae-727342b7a1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83947240-5fe2-4770-90fe-3ab84bd393c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83947240-5fe2-4770-90fe-3ab84bd393c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bcca8a7-2452-4ba3-b2ef-4c3a6764f974', 'volume_name': 'volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d22dbb7-3d71-4f3d-b9b5-b02d0f2e6350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d22dbb7-3d71-4f3d-b9b5-b02d0f2e6350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81f05ae-77c2-4895-9c1c-64aa55ecad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:39 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Volume 0bcca8a7-2452-4ba3-b2ef-4c3a6764f974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974', 'volume_size': 1} Jul 09 15:18:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:42 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec" returned: 0 in 10.386s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:42 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d09f2cd-3f25-41ca-9d82-5896705f90d4]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:42 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a Jul 09 15:18:42 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:43 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a" returned: 0 in 1.491s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:43 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a, size 1024.00 MB, duration 10.39 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:18:43 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Converted 1024.00 MB image at 98.58 MB/s Jul 09 15:18:43 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec is being set with open permissions: ugo+rw Jul 09 15:18:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:43 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec Jul 09 15:18:43 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Flow 'volume_create_manager' (3e5bb261-8def-4ea2-a907-5d3d17e6eebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecf9bae-b5f7-4935-a3f0-a65bb213c686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecf9bae-b5f7-4935-a3f0-a65bb213c686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1125141537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d064eef5-b374-44b6-b564-2f496b676181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9449feb677534cb3b9e785b142eeab3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:44Z,use_quota=True,user_id='9fb05015470f4ab7a08edfbc0b7a020e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84fd46e-491a-46ab-a506-db3121e1151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84fd46e-491a-46ab-a506-db3121e1151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f633c2b-244d-416e-bc53-df17e3bb4f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f633c2b-244d-416e-bc53-df17e3bb4f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd064eef5-b374-44b6-b564-2f496b676181', 'volume_name': 'volume-d064eef5-b374-44b6-b564-2f496b676181', 'volume_size': 2}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ac6c48-9b54-4493-ab66-4bcb0beb63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ac6c48-9b54-4493-ab66-4bcb0beb63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8cfda8-ef27-4ea7-ae48-7f38d1c1e99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Volume d064eef5-b374-44b6-b564-2f496b676181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d064eef5-b374-44b6-b564-2f496b676181', 'volume_size': 2} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:44 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec" returned: 0 in 0.705s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-339e9bf0-c8f7-470b-a26f-3560843225ec" released by "_copy_volume_from_snapshot" :: held 16.655s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-7cb8338a-23e1-499a-a780-f5f7f084094f-339e9bf0-c8f7-470b-a26f-3560843225ec" released by "_create_volume_from_snapshot" :: held 16.711s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.741s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.482s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-606145437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcca8a7-2452-4ba3-b2ef-4c3a6764f974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff1dad2237d46199d9e5c016ab6d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:39Z,use_quota=True,user_id='53b71043da3e447ba60d6e43d9bc984c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Creating volume 0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:44 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:44 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 1073741824 Jul 09 15:18:44 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54721282-ea56-4172-a9fb-5858d8722370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339e9bf0-c8f7-470b-a26f-3560843225ec', 'volume_size': 1, 'snapshot_id': '7cb8338a-23e1-499a-a780-f5f7f084094f'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (190dbaeb-fd41-4653-a399-202baa412037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Volume volume-339e9bf0-c8f7-470b-a26f-3560843225ec (339e9bf0-c8f7-470b-a26f-3560843225ec): created successfully Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (190dbaeb-fd41-4653-a399-202baa412037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Flow 'volume_create_manager' (839fffa6-059b-48d7-9f28-e1b53e088007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:44 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-cdab52da-cdd7-4075-ae7f-18261c814a14 tempest-TestStampPattern-1758697979 None] Created volume successfully. Jul 09 15:18:45 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 1073741824" returned: 0 in 0.788s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:45 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 Jul 09 15:18:45 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:46 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" returned: 0 in 0.668s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1125141537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d064eef5-b374-44b6-b564-2f496b676181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9449feb677534cb3b9e785b142eeab3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:44Z,use_quota=True,user_id='9fb05015470f4ab7a08edfbc0b7a020e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Creating volume d064eef5-b374-44b6-b564-2f496b676181 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:46 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 2147483648 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:46 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 2147483648 Jul 09 15:18:46 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81f05ae-77c2-4895-9c1c-64aa55ecad32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955dfeef-058d-4949-892a-3e9331a665a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:46 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Volume volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 (0bcca8a7-2452-4ba3-b2ef-4c3a6764f974): created successfully Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955dfeef-058d-4949-892a-3e9331a665a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Flow 'volume_create_manager' (be9f3dc1-8b4f-46a3-9be6-4b309bc92144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:46 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8cc5a6c0-2671-44f3-9ff1-7489da0e5213 tempest-VolumesDeleteCascade-359713631 None] Created volume successfully. Jul 09 15:18:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:47 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 2147483648" returned: 0 in 0.954s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:47 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 Jul 09 15:18:47 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:47 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181" returned: 0 in 0.719s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.351s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8cfda8-ef27-4ea7-ae48-7f38d1c1e99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d064eef5-b374-44b6-b564-2f496b676181', 'volume_size': 2}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843666df-a7ec-4a09-bf08-5aded3617428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Creating offline snapshot b86d8e05-a95f-4fa5-a184-0f848ece0393 of volume 0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:18:48 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Volume volume-d064eef5-b374-44b6-b564-2f496b676181 (d064eef5-b374-44b6-b564-2f496b676181): created successfully Jul 09 15:18:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843666df-a7ec-4a09-bf08-5aded3617428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:48 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Flow 'volume_create_manager' (3e5bb261-8def-4ea2-a907-5d3d17e6eebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:48 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbee8b0-31da-404c-a600-f8c67db3edb0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:48 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6bba90da-0826-4117-9a1e-7073772c8911 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Created volume successfully. Jul 09 15:18:48 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 Jul 09 15:18:48 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:48 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" returned: 0 in 0.819s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:48 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 1G Jul 09 15:18:48 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:49 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 1G" returned: 0 in 1.038s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:49 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 Jul 09 15:18:49 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:50 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393" returned: 0 in 0.815s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:50 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 is being set with open permissions: ugo+rw Jul 09 15:18:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:50 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 Jul 09 15:18:50 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:51 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393" returned: 0 in 0.932s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:51 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.info Jul 09 15:18:51 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:52 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.info" returned: 0 in 0.804s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:52 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.info is being set with open permissions: ugo+rw Jul 09 15:18:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:52 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.info Jul 09 15:18:52 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:53 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.info" returned: 0 in 0.726s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.261s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.459s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Creating offline snapshot 717cb22b-8c12-46a7-bc57-15ff37e1ba6d of volume d064eef5-b374-44b6-b564-2f496b676181 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:18:53 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-408af208-0d63-4d69-870e-60732b2faecf tempest-VolumesDeleteCascade-359713631 None] Create snapshot completed successfully Jul 09 15:18:53 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5b5623-665b-49e6-9b59-8265164cd7bc]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:53 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 Jul 09 15:18:53 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:54 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181" returned: 0 in 1.013s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d 2G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:54 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d 2G Jul 09 15:18:54 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-ad3a75e3-63ad-4042-819f-6202458d40e9 req-c795cade-691b-41c5-9e34-53bec64cccde tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:55 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d 2G" returned: 0 in 0.951s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d064eef5-b374-44b6-b564-2f496b676181 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:55 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d064eef5-b374-44b6-b564-2f496b676181 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d Jul 09 15:18:55 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:55 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d064eef5-b374-44b6-b564-2f496b676181 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d" returned: 0 in 0.736s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:56 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d is being set with open permissions: ugo+rw Jul 09 15:18:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:56 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d Jul 09 15:18:56 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:56 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d" returned: 0 in 0.622s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:56 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.info Jul 09 15:18:56 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:57 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.info" returned: 0 in 0.637s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:57 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.info is being set with open permissions: ugo+rw Jul 09 15:18:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:57 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.info Jul 09 15:18:57 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:57 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.info" returned: 0 in 0.662s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.744s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.745s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] Creating offline snapshot d3e3d486-b47f-4d40-819a-44cc77f1af20 of volume 0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:18:58 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1822bcc7-2bd4-49fb-9d6e-7be5ccf5e275 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Create snapshot completed successfully Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bf6dd6-9de6-4513-8990-1eac941cf828]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:58 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 Jul 09 15:18:58 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Acquiring lock "cinder-717cb22b-8c12-46a7-bc57-15ff37e1ba6d-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "cinder-717cb22b-8c12-46a7-bc57-15ff37e1ba6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Acquiring lock "cinder-quobyte-d064eef5-b374-44b6-b564-2f496b676181" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "cinder-quobyte-d064eef5-b374-44b6-b564-2f496b676181" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Acquiring lock "cinder-quobyte-717cb22b-8c12-46a7-bc57-15ff37e1ba6d" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "cinder-quobyte-717cb22b-8c12-46a7-bc57-15ff37e1ba6d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Deleting offline snapshot 717cb22b-8c12-46a7-bc57-15ff37e1ba6d of volume d064eef5-b374-44b6-b564-2f496b676181 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] snapshot_file for this snap is: volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c60663-8589-47a3-bad7-1a00e0e058f0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:58 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d Jul 09 15:18:58 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:58 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393" returned: 0 in 0.818s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:18:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:58 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 1G Jul 09 15:18:58 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:59 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d" returned: 0 in 0.873s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d064eef5-b374-44b6-b564-2f496b676181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:18:59 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b526f7-16bf-4191-8609-e2cacf7e7a1a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:59 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 Jul 09 15:18:59 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:59 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 1G" returned: 0 in 0.887s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:59 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 Jul 09 15:18:59 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:00 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181" returned: 0 in 0.835s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:00 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d Jul 09 15:19:00 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:00 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20" returned: 0 in 0.816s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:00 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 is being set with open permissions: ugo+rw Jul 09 15:19:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:00 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 Jul 09 15:19:00 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:01 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d" returned: 0 in 0.915s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:01 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d Jul 09 15:19:01 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:01 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20" returned: 0 in 0.667s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.334s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-ad3a75e3-63ad-4042-819f-6202458d40e9 req-c795cade-691b-41c5-9e34-53bec64cccde tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.784s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3a2cc1-e6e8-4e3c-900d-482c8c588fc3]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-ad3a75e3-63ad-4042-819f-6202458d40e9 req-c795cade-691b-41c5-9e34-53bec64cccde tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:01 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-bb992300-509e-41f9-827c-35820601df8e tempest-VolumesDeleteCascade-359713631 None] Create snapshot completed successfully Jul 09 15:19:01 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 Jul 09 15:19:01 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Performing cascade delete. {{(pid=87042) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-b86d8e05-a95f-4fa5-a184-0f848ece0393-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-b86d8e05-a95f-4fa5-a184-0f848ece0393-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-b86d8e05-a95f-4fa5-a184-0f848ece0393" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-b86d8e05-a95f-4fa5-a184-0f848ece0393" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Deleting offline snapshot b86d8e05-a95f-4fa5-a184-0f848ece0393 of volume 0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] snapshot_file for this snap is: volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f2a78-e655-4b95-8994-9c8bc3a45ee1]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:02 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 Jul 09 15:19:02 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:02 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181.717cb22b-8c12-46a7-bc57-15ff37e1ba6d" returned: 0 in 1.023s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "cinder-quobyte-717cb22b-8c12-46a7-bc57-15ff37e1ba6d" released by "_delete_snapshot" :: held 3.776s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "cinder-quobyte-d064eef5-b374-44b6-b564-2f496b676181" released by "delete_snapshot" :: held 3.810s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Created reservations ['54d6bddf-b29c-441f-bc6e-2624e8c66e70', 'cea91bc0-c7eb-46d2-b8c8-acffb1f34c9f', 'ca78c768-c17a-44fb-9596-e5ff6e4a7fc3', 'd68f9097-798e-41c2-9c32-66254c06a5a8'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:02 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-ad3a75e3-63ad-4042-819f-6202458d40e9 req-c795cade-691b-41c5-9e34-53bec64cccde tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8" returned: 0 in 0.998s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-ad3a75e3-63ad-4042-819f-6202458d40e9 req-c795cade-691b-41c5-9e34-53bec64cccde tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.021s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:02 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Delete snapshot completed successfully. Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-825285f3-0dca-4f88-b3f7-8ab83c38e2b3 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "cinder-717cb22b-8c12-46a7-bc57-15ff37e1ba6d-delete_snapshot" released by "delete_snapshot" :: held 4.034s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-ad3a75e3-63ad-4042-819f-6202458d40e9 req-c795cade-691b-41c5-9e34-53bec64cccde tempest-TestInstancesWithCinderVolumes-407364947 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-300aa0b6-584f-491c-aa73-2eb57f609ad8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '986fa8b7-63fc-4a1c-82e3-62efdc374cb4', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:19:02 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-ad3a75e3-63ad-4042-819f-6202458d40e9 req-c795cade-691b-41c5-9e34-53bec64cccde tempest-TestInstancesWithCinderVolumes-407364947 None] attachment_update completed successfully. Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Acquiring lock "cinder-d064eef5-b374-44b6-b564-2f496b676181-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "cinder-d064eef5-b374-44b6-b564-2f496b676181-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Acquiring lock "cinder-quobyte-d064eef5-b374-44b6-b564-2f496b676181" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "cinder-quobyte-d064eef5-b374-44b6-b564-2f496b676181" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a4b500-d321-433c-b793-ff64e37f455b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:02 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393" returned: 0 in 1.015s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae080449-7684-4462-96e7-642d05765f76]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:03 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 Jul 09 15:19:03 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:03 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 Jul 09 15:19:03 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:03 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181" returned: 0 in 0.866s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:03 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" returned: 0 in 0.812s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:03 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181 Jul 09 15:19:03 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:03 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5a8873-d6ad-47bb-930f-746bd90d6efa]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:04 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 Jul 09 15:19:04 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:04 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d064eef5-b374-44b6-b564-2f496b676181" returned: 0 in 0.710s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "cinder-quobyte-d064eef5-b374-44b6-b564-2f496b676181" released by "delete_volume" :: held 1.659s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Created reservations ['e2ef4e42-030a-4634-8e26-f7c064b8f6ce', '762e0a3b-67d9-4c25-ab70-c30dc0e239ba', '6d41ce2a-1b3f-4ced-9c1d-0c4a1fa447c9', 'f89ce926-579f-4674-a326-f34694fe6020'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:04 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:19:04 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:04 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20" returned: 0 in 0.877s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dde69e0-6b1d-41ad-822f-7cb5b14ae720]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:04 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 Jul 09 15:19:04 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:04 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:19:04 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:05 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.794s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:05 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Deleted volume successfully. Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eeb80f3e-7cd7-40b1-b2ae-34f7878e2a87 tempest-VolumesSnapshotNegativeTestJSON-641597537 None] Lock "cinder-d064eef5-b374-44b6-b564-2f496b676181-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:05 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.738s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:19:05 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393" returned: 0 in 0.988s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf42163-e5ad-403f-9b2f-3752536c28a3]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:05 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 Jul 09 15:19:05 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:06 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" returned: 0 in 0.983s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:06 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 Jul 09 15:19:06 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:07 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393" returned: 0 in 0.848s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:07 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393 Jul 09 15:19:07 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:08 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.b86d8e05-a95f-4fa5-a184-0f848ece0393" returned: 0 in 0.678s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 -F qcow2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:08 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 -F qcow2 Jul 09 15:19:08 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:09 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 -F qcow2" returned: 0 in 0.767s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-b86d8e05-a95f-4fa5-a184-0f848ece0393" released by "_delete_snapshot" :: held 7.177s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" released by "delete_snapshot" :: held 7.207s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Created reservations ['f06a0cfa-9f8e-42b2-a263-943822f893a4', 'dc76cb53-9e22-4bf7-8d96-d4ad4ceadb97', 'e19d385a-b175-488a-9683-f919291555e1', 'def7e0ae-c58e-4a54-9624-1cb31b3cecf4'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Delete snapshot completed successfully. Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-b86d8e05-a95f-4fa5-a184-0f848ece0393-delete_snapshot" released by "delete_snapshot" :: held 7.368s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-d3e3d486-b47f-4d40-819a-44cc77f1af20-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-d3e3d486-b47f-4d40-819a-44cc77f1af20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-d3e3d486-b47f-4d40-819a-44cc77f1af20" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-d3e3d486-b47f-4d40-819a-44cc77f1af20" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Deleting offline snapshot d3e3d486-b47f-4d40-819a-44cc77f1af20 of volume 0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] snapshot_file for this snap is: volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00acf20-2a01-47b1-a303-81122d1779c4]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:09 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 Jul 09 15:19:09 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:10 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20" returned: 0 in 0.814s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:19:10 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[739c4d58-cfec-43ca-a97b-325648caebe9]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:10 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 Jul 09 15:19:10 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-ec0e8da0-ec52-4403-a4d9-34b0be168dc8 req-55696572-4f10-4220-8226-3a5b5b3cd59a tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-ec0e8da0-ec52-4403-a4d9-34b0be168dc8 req-55696572-4f10-4220-8226-3a5b5b3cd59a tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:10 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd3f35a-b99f-498d-a3a0-ffb8f76ff925]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-ec0e8da0-ec52-4403-a4d9-34b0be168dc8 req-55696572-4f10-4220-8226-3a5b5b3cd59a tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:10 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b Jul 09 15:19:10 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:11 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" returned: 0 in 0.842s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:11 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 Jul 09 15:19:11 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:11 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-ec0e8da0-ec52-4403-a4d9-34b0be168dc8 req-55696572-4f10-4220-8226-3a5b5b3cd59a tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b" returned: 0 in 0.898s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-ec0e8da0-ec52-4403-a4d9-34b0be168dc8 req-55696572-4f10-4220-8226-3a5b5b3cd59a tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.925s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-ec0e8da0-ec52-4403-a4d9-34b0be168dc8 req-55696572-4f10-4220-8226-3a5b5b3cd59a tempest-TestInstancesWithCinderVolumes-407364947 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-39514aef-5365-4068-a982-4321fc9e368b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94284109-210d-4505-8c50-4367f062244e', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:19:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-ec0e8da0-ec52-4403-a4d9-34b0be168dc8 req-55696572-4f10-4220-8226-3a5b5b3cd59a tempest-TestInstancesWithCinderVolumes-407364947 None] attachment_update completed successfully. Jul 09 15:19:11 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20" returned: 0 in 0.820s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:11 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20 Jul 09 15:19:11 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:12 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974.d3e3d486-b47f-4d40-819a-44cc77f1af20" returned: 0 in 0.779s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-d3e3d486-b47f-4d40-819a-44cc77f1af20" released by "_delete_snapshot" :: held 3.383s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" released by "delete_snapshot" :: held 3.409s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:12 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Created reservations ['82f20cb7-fe8f-46f0-be80-659fd808349d', 'b5aa143e-7452-4f46-82b4-3475c1b0fbeb', '835d9050-fa99-4427-803f-e47f1914e300', '8fb112d6-7a6f-43e8-ae4c-6b9f60d4df7e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:12 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Delete snapshot completed successfully. Jul 09 15:19:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-d3e3d486-b47f-4d40-819a-44cc77f1af20-delete_snapshot" released by "delete_snapshot" :: held 3.590s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Snapshots deleted, issuing volume delete {{(pid=87042) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 15:19:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" acquired by "delete_volume" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:12 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad8210d-abac-4f3a-b9c2-e583407ceb2e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:13 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 Jul 09 15:19:13 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:13 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" returned: 0 in 0.874s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:13 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974 Jul 09 15:19:13 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:14 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" returned: 0 in 0.820s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974" released by "delete_volume" :: held 1.807s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:14 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Created reservations ['c6eeba1b-11fc-41f4-b2a1-a8200bf3a237', '87b5fef9-1234-442f-8d6d-f3ef1d383b7d', '3b2c3893-7380-4248-9661-7233bd633fdd', '5d770cc0-e59f-47fa-af7c-b4f31213821c'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:14 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:19:14 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:16 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Flow 'volume_create_manager' (6d36ef67-db3e-4c8d-ad23-aceddb070f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae42ea8a-859d-4432-9ff3-ed97a79f59f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.274s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae42ea8a-859d-4432-9ff3-ed97a79f59f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1797913488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a49709-953c-4285-828e-79b19160bbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff1dad2237d46199d9e5c016ab6d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:16Z,use_quota=True,user_id='53b71043da3e447ba60d6e43d9bc984c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d001e482-0336-47e7-8238-20d7c646ef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d001e482-0336-47e7-8238-20d7c646ef74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9caf483-a1ec-47b4-9713-412ec58bf7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9caf483-a1ec-47b4-9713-412ec58bf7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a49709-953c-4285-828e-79b19160bbf1', 'volume_name': 'volume-65a49709-953c-4285-828e-79b19160bbf1', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660a3b0b-54b7-40fa-9cec-3adcf8d7ab52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660a3b0b-54b7-40fa-9cec-3adcf8d7ab52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5c7d59-9e86-4739-9f5d-778cd8a25f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:16 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Volume 65a49709-953c-4285-828e-79b19160bbf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a49709-953c-4285-828e-79b19160bbf1', 'volume_size': 1} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1797913488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a49709-953c-4285-828e-79b19160bbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff1dad2237d46199d9e5c016ab6d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:16Z,use_quota=True,user_id='53b71043da3e447ba60d6e43d9bc984c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Creating volume 65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:16 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:16 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Deleted volume successfully. Jul 09 15:19:16 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 1073741824 Jul 09 15:19:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-362787e4-a2dc-470c-8db3-13d3460f649a tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-0bcca8a7-2452-4ba3-b2ef-4c3a6764f974-delete_volume" released by "delete_volume" :: held 14.484s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:16 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:17 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 1073741824" returned: 0 in 1.267s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:17 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 Jul 09 15:19:17 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:18 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1" returned: 0 in 0.685s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:19:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5c7d59-9e86-4739-9f5d-778cd8a25f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a49709-953c-4285-828e-79b19160bbf1', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f76e0a-598b-4919-b7d4-18e4be344794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:18 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Volume volume-65a49709-953c-4285-828e-79b19160bbf1 (65a49709-953c-4285-828e-79b19160bbf1): created successfully Jul 09 15:19:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f76e0a-598b-4919-b7d4-18e4be344794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Flow 'volume_create_manager' (6d36ef67-db3e-4c8d-ad23-aceddb070f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:18 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-967405e7-c700-4a59-b712-0ff9e10ca24f tempest-VolumesDeleteCascade-359713631 None] Created volume successfully. Jul 09 15:19:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Creating offline snapshot 1948e4ac-c295-4323-b862-05c4d3e3df17 of volume 65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:19:19 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[020f07df-988b-499d-97cb-33bd1cae4082]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:19 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 Jul 09 15:19:19 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:20 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-c1cd6a0c-61e0-4464-8f0a-a14ac119aea5 req-865fee7f-d3f7-42d9-8c6d-6f0dc7391406 tempest-TestStampPattern-1758697979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1" returned: 0 in 0.874s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:20 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 1G Jul 09 15:19:20 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:21 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-a06265b8-2c63-4d37-b105-b5b3e57888ca req-223d16bc-f948-4d3d-951a-ee1d9d23e912 tempest-TestInstancesWithCinderVolumes-407364947 None] Terminate volume connection completed successfully. Jul 09 15:19:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-a06265b8-2c63-4d37-b105-b5b3e57888ca req-223d16bc-f948-4d3d-951a-ee1d9d23e912 tempest-TestInstancesWithCinderVolumes-407364947 None] Deleting attachment 986fa8b7-63fc-4a1c-82e3-62efdc374cb4. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:19:21 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 1G" returned: 0 in 0.886s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a49709-953c-4285-828e-79b19160bbf1 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:21 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a49709-953c-4285-828e-79b19160bbf1 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 Jul 09 15:19:21 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:22 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a49709-953c-4285-828e-79b19160bbf1 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17" returned: 0 in 0.757s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:22 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 is being set with open permissions: ugo+rw Jul 09 15:19:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:22 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 Jul 09 15:19:22 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:22 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17" returned: 0 in 0.686s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:22 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.info Jul 09 15:19:22 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "cinder-300aa0b6-584f-491c-aa73-2eb57f609ad8-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-300aa0b6-584f-491c-aa73-2eb57f609ad8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "cinder-quobyte-300aa0b6-584f-491c-aa73-2eb57f609ad8" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-quobyte-300aa0b6-584f-491c-aa73-2eb57f609ad8" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f9cc9b-aa45-4113-a335-460b59118e73]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:23 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 Jul 09 15:19:23 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:23 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.info" returned: 0 in 0.980s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:23 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.info is being set with open permissions: ugo+rw Jul 09 15:19:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:23 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.info Jul 09 15:19:23 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:24 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8" returned: 0 in 1.014s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:24 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8 Jul 09 15:19:24 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:24 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.info" returned: 0 in 0.823s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.147s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-c1cd6a0c-61e0-4464-8f0a-a14ac119aea5 req-865fee7f-d3f7-42d9-8c6d-6f0dc7391406 tempest-TestStampPattern-1758697979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.232s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:24 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11d7e16-2ac6-4333-9bb1-49c90384b751]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-c1cd6a0c-61e0-4464-8f0a-a14ac119aea5 req-865fee7f-d3f7-42d9-8c6d-6f0dc7391406 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:24 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0c2b89fa-2417-4d93-88a1-331cbc5fe456 tempest-VolumesDeleteCascade-359713631 None] Create snapshot completed successfully Jul 09 15:19:24 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec Jul 09 15:19:24 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:25 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-300aa0b6-584f-491c-aa73-2eb57f609ad8" returned: 0 in 0.804s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-quobyte-300aa0b6-584f-491c-aa73-2eb57f609ad8" released by "delete_volume" :: held 1.899s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=69,cinder:INSERT=20,cinder:UPDATE=64,cinder:DELETE=8 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:DELETE=5,cinder:UPDATE=72,cinder:SELECT=75,cinder:INSERT=14 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:19:25 devstack cinder-volume[87042]: WARNING cinder.quota [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887996567-1719834356 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887996567-1719834356, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:19:25 devstack cinder-volume[87042]: WARNING cinder.quota [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887996567-1719834356 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887996567-1719834356, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Created reservations ['42d5bfad-c03d-46d9-bb52-2dcf747d16ba', 'db412f0f-cf78-48a5-8d15-c7cdb930b48d', '0b0f4a0a-6f94-4958-a68c-35435481db86', 'd65da6ed-5947-4243-82e0-ac8401f2bb59'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:25 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:25 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-c1cd6a0c-61e0-4464-8f0a-a14ac119aea5 req-865fee7f-d3f7-42d9-8c6d-6f0dc7391406 tempest-TestStampPattern-1758697979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec" returned: 0 in 1.024s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:25 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-c1cd6a0c-61e0-4464-8f0a-a14ac119aea5 req-865fee7f-d3f7-42d9-8c6d-6f0dc7391406 tempest-TestStampPattern-1758697979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.057s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-c1cd6a0c-61e0-4464-8f0a-a14ac119aea5 req-865fee7f-d3f7-42d9-8c6d-6f0dc7391406 tempest-TestStampPattern-1758697979 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-339e9bf0-c8f7-470b-a26f-3560843225ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0467516f-3c74-41f8-b258-d267dc7abbc5', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:19:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-c1cd6a0c-61e0-4464-8f0a-a14ac119aea5 req-865fee7f-d3f7-42d9-8c6d-6f0dc7391406 tempest-TestStampPattern-1758697979 None] attachment_update completed successfully. Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Flow 'volume_create_manager' (d48168af-43c4-4bf9-9f68-06e849d0aed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a1d745-d157-48d5-8425-e46a4a8dd66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a1d745-d157-48d5-8425-e46a4a8dd66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1642483298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db080736-9d3d-433d-a732-45a2323c60cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff1dad2237d46199d9e5c016ab6d889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1948e4ac-c295-4323-b862-05c4d3e3df17,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:26Z,use_quota=True,user_id='53b71043da3e447ba60d6e43d9bc984c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30747314-b6bd-421b-bcc8-9c9f4ed60c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30747314-b6bd-421b-bcc8-9c9f4ed60c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb4f54d-a550-4a97-9418-bf1c7c09150d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb4f54d-a550-4a97-9418-bf1c7c09150d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db080736-9d3d-433d-a732-45a2323c60cd', 'volume_name': 'volume-db080736-9d3d-433d-a732-45a2323c60cd', 'volume_size': 1, 'snapshot_id': '1948e4ac-c295-4323-b862-05c4d3e3df17'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ec96a0-d032-4e70-bfd6-c3945acd8224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ec96a0-d032-4e70-bfd6-c3945acd8224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4989d9b1-fb4d-449a-83a9-fb70bc5f3b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:26 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Volume db080736-9d3d-433d-a732-45a2323c60cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db080736-9d3d-433d-a732-45a2323c60cd', 'volume_size': 1, 'snapshot_id': '1948e4ac-c295-4323-b862-05c4d3e3df17'} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-1948e4ac-c295-4323-b862-05c4d3e3df17-db080736-9d3d-433d-a732-45a2323c60cd" by "_create_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-1948e4ac-c295-4323-b862-05c4d3e3df17-db080736-9d3d-433d-a732-45a2323c60cd" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Creating volume db080736-9d3d-433d-a732-45a2323c60cd from snapshot 1948e4ac-c295-4323-b862-05c4d3e3df17 {{(pid=87042) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-db080736-9d3d-433d-a732-45a2323c60cd" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-db080736-9d3d-433d-a732-45a2323c60cd" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] snapshot: 1948e4ac-c295-4323-b862-05c4d3e3df17, volume: db080736-9d3d-433d-a732-45a2323c60cd, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37218a3-5b16-43d6-86a9-adc0210f6495]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:26 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 Jul 09 15:19:26 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:26 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.002s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Deleted volume successfully. Jul 09 15:19:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0a07dde5-eb18-4940-a6dc-3aaec4dcd079 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-300aa0b6-584f-491c-aa73-2eb57f609ad8-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:27 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17" returned: 0 in 1.030s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65a49709-953c-4285-828e-79b19160bbf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:19:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:19:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:19:27 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[db49e9e7-ee63-43c5-aac3-5d7a77ad672a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:27 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 Jul 09 15:19:27 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:28 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1" returned: 0 in 0.854s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:28 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:19:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:28 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd Jul 09 15:19:28 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:28 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-1e53331f-5fd0-4c96-aa39-8a7e6cbfed31 req-baf1eea5-21a0-45a9-86b6-302c16601e47 tempest-TestInstancesWithCinderVolumes-407364947 None] Terminate volume connection completed successfully. Jul 09 15:19:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-1e53331f-5fd0-4c96-aa39-8a7e6cbfed31 req-baf1eea5-21a0-45a9-86b6-302c16601e47 tempest-TestInstancesWithCinderVolumes-407364947 None] Deleting attachment 94284109-210d-4505-8c50-4367f062244e. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:19:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "cinder-39514aef-5365-4068-a982-4321fc9e368b-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-39514aef-5365-4068-a982-4321fc9e368b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "cinder-quobyte-39514aef-5365-4068-a982-4321fc9e368b" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-quobyte-39514aef-5365-4068-a982-4321fc9e368b" acquired by "delete_volume" :: waited 0.073s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d7285a-5c86-49d1-865f-2b319760b994]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:31 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b Jul 09 15:19:31 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:33 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b" returned: 0 in 1.623s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:33 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b Jul 09 15:19:33 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:34 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd" returned: 0 in 6.623s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:34 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3d8bfc-fca9-46c8-9c1e-416ab8dba923]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-5a19d342-e32c-4ee8-b0bf-6c0518526633 req-ff388c0d-4c93-482d-87a5-5865e72e9e5a tempest-TestStampPattern-1758697979 None] Terminate volume connection completed successfully. Jul 09 15:19:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-5a19d342-e32c-4ee8-b0bf-6c0518526633 req-ff388c0d-4c93-482d-87a5-5865e72e9e5a tempest-TestStampPattern-1758697979 None] Deleting attachment 0467516f-3c74-41f8-b258-d267dc7abbc5. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:19:35 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 Jul 09 15:19:35 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:35 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-39514aef-5365-4068-a982-4321fc9e368b" returned: 0 in 2.111s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-quobyte-39514aef-5365-4068-a982-4321fc9e368b" released by "delete_volume" :: held 3.872s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:35 devstack cinder-volume[87042]: WARNING cinder.quota [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-528171914-313253058 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-528171914-313253058, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:19:35 devstack cinder-volume[87042]: WARNING cinder.quota [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-528171914-313253058 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-528171914-313253058, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:19:35 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Created reservations ['7f2df7b5-c952-416d-936c-6db0f073173b', '7f3266ea-5ac9-42fa-8ae9-7deb9fedb183', '65c5d389-6958-4d2f-8ff0-74a4ee183f71', '556c115a-a3a7-4fa4-8b26-1dc4d157ea5b'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:35 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:19:35 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:36 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1" returned: 0 in 1.429s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:36 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:19:36 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:36 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Converted 1024.00 MB image at 154.55 MB/s Jul 09 15:19:36 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd is being set with open permissions: ugo+rw Jul 09 15:19:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.041s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:36 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Deleted volume successfully. Jul 09 15:19:36 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd Jul 09 15:19:36 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-da11299c-e20e-4b2d-b884-3a96d0d56d41 tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-39514aef-5365-4068-a982-4321fc9e368b-delete_volume" released by "delete_volume" :: held 5.330s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:37 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd" returned: 0 in 1.058s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-db080736-9d3d-433d-a732-45a2323c60cd" released by "_copy_volume_from_snapshot" :: held 11.163s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-1948e4ac-c295-4323-b862-05c4d3e3df17-db080736-9d3d-433d-a732-45a2323c60cd" released by "_create_volume_from_snapshot" :: held 11.222s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.240s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4989d9b1-fb4d-449a-83a9-fb70bc5f3b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db080736-9d3d-433d-a732-45a2323c60cd', 'volume_size': 1, 'snapshot_id': '1948e4ac-c295-4323-b862-05c4d3e3df17'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfbb0db-4b99-416a-9c1b-a087697597e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:37 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Volume volume-db080736-9d3d-433d-a732-45a2323c60cd (db080736-9d3d-433d-a732-45a2323c60cd): created successfully Jul 09 15:19:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfbb0db-4b99-416a-9c1b-a087697597e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Flow 'volume_create_manager' (d48168af-43c4-4bf9-9f68-06e849d0aed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-59b421c1-e461-4f4e-91ed-4c0d020919c0 tempest-VolumesDeleteCascade-359713631 None] Created volume successfully. Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-65a49709-953c-4285-828e-79b19160bbf1-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-65a49709-953c-4285-828e-79b19160bbf1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Performing cascade delete. {{(pid=87042) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-1948e4ac-c295-4323-b862-05c4d3e3df17-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-1948e4ac-c295-4323-b862-05c4d3e3df17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-65a49709-953c-4285-828e-79b19160bbf1" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-65a49709-953c-4285-828e-79b19160bbf1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-1948e4ac-c295-4323-b862-05c4d3e3df17" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-1948e4ac-c295-4323-b862-05c4d3e3df17" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Deleting offline snapshot 1948e4ac-c295-4323-b862-05c4d3e3df17 of volume 65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:19:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] snapshot_file for this snap is: volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:19:39 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31353c5-401c-4aae-9644-d92adfdc1ace]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:39 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 Jul 09 15:19:39 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:40 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17" returned: 0 in 1.307s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65a49709-953c-4285-828e-79b19160bbf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:19:40 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aecee1a-a4ab-43e8-8101-5df58f24c980]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:40 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 Jul 09 15:19:40 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:41 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1" returned: 0 in 1.121s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:41 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 Jul 09 15:19:41 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:42 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-3c619b4d-aa9d-489a-adab-8a41ea1eac23 req-dc8be98a-b624-4949-99dd-e1fa5ba68cb7 tempest-TestInstancesWithCinderVolumes-407364947 None] Terminate volume connection completed successfully. Jul 09 15:19:42 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-3c619b4d-aa9d-489a-adab-8a41ea1eac23 req-dc8be98a-b624-4949-99dd-e1fa5ba68cb7 tempest-TestInstancesWithCinderVolumes-407364947 None] Deleting attachment ead2cd79-3b56-42f5-ab6f-0d2b8b750cd8. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:19:42 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17" returned: 0 in 0.827s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:42 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17 Jul 09 15:19:42 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:42 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1.1948e4ac-c295-4323-b862-05c4d3e3df17" returned: 0 in 0.667s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-1948e4ac-c295-4323-b862-05c4d3e3df17" released by "_delete_snapshot" :: held 4.107s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-65a49709-953c-4285-828e-79b19160bbf1" released by "delete_snapshot" :: held 4.132s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:43 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Created reservations ['ec63cb78-b9a0-4850-a9cb-845b26657a93', 'd819d460-1c64-47e1-a30b-b1df5939f7ae', 'f04549ad-b0e7-414e-9cd7-a21959e11f26', 'ddce6f33-bd05-4c79-b39b-cf9ff5d1e9af'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:43 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Delete snapshot completed successfully. Jul 09 15:19:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-1948e4ac-c295-4323-b862-05c4d3e3df17-delete_snapshot" released by "delete_snapshot" :: held 4.335s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:43 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Snapshots deleted, issuing volume delete {{(pid=87042) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 15:19:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-65a49709-953c-4285-828e-79b19160bbf1" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-65a49709-953c-4285-828e-79b19160bbf1" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:43 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b5b637-7cc2-4384-aba7-59f69667fb8d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:43 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 Jul 09 15:19:43 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:44 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1" returned: 0 in 0.776s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:44 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1 Jul 09 15:19:44 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:44 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-65a49709-953c-4285-828e-79b19160bbf1" returned: 0 in 0.705s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-65a49709-953c-4285-828e-79b19160bbf1" released by "delete_volume" :: held 1.551s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Created reservations ['10788119-5a06-49e6-b7f0-b29b2aa960e1', 'cfc5a825-baeb-4cf1-a561-913867f89f56', 'ab0a97fb-a4b0-410a-9bed-17b7f31f33ef', '6117746e-0442-4ad2-8ceb-6661bf698679'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:45 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:19:45 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-db080736-9d3d-433d-a732-45a2323c60cd-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-db080736-9d3d-433d-a732-45a2323c60cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "cinder-quobyte-db080736-9d3d-433d-a732-45a2323c60cd" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-db080736-9d3d-433d-a732-45a2323c60cd" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaf03ac-f1d1-4031-b10e-220c8d36eb8c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Acquiring lock "cinder-339e9bf0-c8f7-470b-a26f-3560843225ec-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Lock "cinder-339e9bf0-c8f7-470b-a26f-3560843225ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Acquiring lock "cinder-quobyte-339e9bf0-c8f7-470b-a26f-3560843225ec" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-339e9bf0-c8f7-470b-a26f-3560843225ec" acquired by "delete_volume" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:45 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.009s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:45 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:46 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Deleted volume successfully. Jul 09 15:19:46 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd Jul 09 15:19:46 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e822a8b8-b122-43ad-af46-c1ab51f181ed]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f91869f8-c213-4a64-bd42-afa6ec2ba630 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-65a49709-953c-4285-828e-79b19160bbf1-delete_volume" released by "delete_volume" :: held 7.286s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:46 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec Jul 09 15:19:46 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:47 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd" returned: 0 in 1.247s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:47 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd Jul 09 15:19:47 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:47 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec" returned: 0 in 1.206s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:47 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec Jul 09 15:19:47 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "cinder-db4d6549-bf66-4cf9-a49b-6a43e11a901c-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-db4d6549-bf66-4cf9-a49b-6a43e11a901c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "cinder-quobyte-db4d6549-bf66-4cf9-a49b-6a43e11a901c" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-quobyte-db4d6549-bf66-4cf9-a49b-6a43e11a901c" acquired by "delete_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:47 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db080736-9d3d-433d-a732-45a2323c60cd" returned: 0 in 0.888s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-quobyte-db080736-9d3d-433d-a732-45a2323c60cd" released by "delete_volume" :: held 2.229s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0d7e42-19c1-4935-a007-2fc0070d7bb2]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Created reservations ['8c891049-a2c6-4e25-960f-c3c0ded3800b', '7ac66ef2-6d74-43b4-bc7e-d19c736b1af3', '23fd48b8-3946-4fed-bd08-e86dc8d2c456', 'f4a989a4-1025-4c23-b669-d9af4239427d'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:48 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c Jul 09 15:19:48 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:48 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:19:48 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:48 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-339e9bf0-c8f7-470b-a26f-3560843225ec" returned: 0 in 1.072s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-339e9bf0-c8f7-470b-a26f-3560843225ec" released by "delete_volume" :: held 2.356s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Created reservations ['61202ffe-278c-4fe2-8f71-1118780db033', '75c5c2c6-c848-43e2-973c-cad0cc8c2fea', '12cadb62-e713-494b-9975-303f75779703', '2ae3febc-2818-4d5a-b5df-98cd19e1b37b'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:48 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:19:48 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:49 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.804s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:49 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Deleted volume successfully. Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b0a5a816-1ccf-4200-8404-f9c95a4d49e7 tempest-VolumesDeleteCascade-359713631 None] Lock "cinder-db080736-9d3d-433d-a732-45a2323c60cd-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:49 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c" returned: 0 in 1.059s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:49 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c Jul 09 15:19:49 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:49 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.062s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:49 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Deleted volume successfully. Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6b21c5ad-9792-4d61-8657-f6f1399a1474 tempest-TestStampPattern-1758697979 None] Lock "cinder-339e9bf0-c8f7-470b-a26f-3560843225ec-delete_volume" released by "delete_volume" :: held 3.741s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Acquiring lock "cinder-7cb8338a-23e1-499a-a780-f5f7f084094f-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Lock "cinder-7cb8338a-23e1-499a-a780-f5f7f084094f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Acquiring lock "cinder-quobyte-18781141-a144-4529-94f6-3ff4a253bc5a" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-18781141-a144-4529-94f6-3ff4a253bc5a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Acquiring lock "cinder-quobyte-7cb8338a-23e1-499a-a780-f5f7f084094f" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-7cb8338a-23e1-499a-a780-f5f7f084094f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Deleting offline snapshot 7cb8338a-23e1-499a-a780-f5f7f084094f of volume 18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] snapshot_file for this snap is: volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a04a25-0b72-48c8-b513-125b9857eaec]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:50 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c" returned: 1 in 0.978s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:19:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:50 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c Jul 09 15:19:50 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:50 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f Jul 09 15:19:50 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:50 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-db4d6549-bf66-4cf9-a49b-6a43e11a901c" returned: 0 in 0.942s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-quobyte-db4d6549-bf66-4cf9-a49b-6a43e11a901c" released by "delete_volume" :: held 3.114s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:51 devstack cinder-volume[87042]: WARNING cinder.quota [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-539964932-2139375135 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-539964932-2139375135, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:19:51 devstack cinder-volume[87042]: WARNING cinder.quota [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-539964932-2139375135 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-539964932-2139375135, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:19:51 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f" returned: 0 in 1.208s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18781141-a144-4529-94f6-3ff4a253bc5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Created reservations ['66433996-5f74-4fc9-a7f4-f69777d16152', 'bae86cae-768f-4878-95a9-dcc8f3679cce', '384d33b4-79e1-41a9-906e-273fc35a297c', 'a655b6ad-811d-413d-bb7a-9c5eebcd4b07'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c9c4d8-9f1b-4a7c-b4ef-719227fca479]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:51 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:19:51 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:51 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a Jul 09 15:19:51 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:52 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a" returned: 0 in 1.090s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:52 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f Jul 09 15:19:52 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:52 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.053s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:52 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:52 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Deleted volume successfully. Jul 09 15:19:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a50adbf6-6c1b-471c-a494-49876e50006a tempest-TestInstancesWithCinderVolumes-407364947 None] Lock "cinder-db4d6549-bf66-4cf9-a49b-6a43e11a901c-delete_volume" released by "delete_volume" :: held 4.736s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:53 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f" returned: 0 in 0.995s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:53 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f Jul 09 15:19:53 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Flow 'volume_create_manager' (329cd47e-f13f-45d4-a703-22cf1ca0d329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22a50d1-ed59-4b4b-8e12-68ede523f004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22a50d1-ed59-4b4b-8e12-68ede523f004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-489616627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f3fa75-359b-4ff6-8e55-43b2de91d0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4308c1ccd74f9b8a4be5aa615c847f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:54Z,use_quota=True,user_id='3214856cc72b4bfa9b205873c3940a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f048bb48-000b-4019-bb7f-0abd4059e353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f048bb48-000b-4019-bb7f-0abd4059e353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb26ed3-d543-4fa3-8fe4-15e5d68d0b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.image.glance [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Creating Keystone auth plugin from conf {{(pid=87042) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:19:54 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a.7cb8338a-23e1-499a-a780-f5f7f084094f" returned: 0 in 1.251s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-7cb8338a-23e1-499a-a780-f5f7f084094f" released by "_delete_snapshot" :: held 4.773s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-18781141-a144-4529-94f6-3ff4a253bc5a" released by "delete_snapshot" :: held 4.819s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:54 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Created reservations ['87874ef4-3992-4b96-bbaa-dc2db08c756a', 'fea2c771-5909-470f-aa48-471261e8db21', '6ceac60f-da9e-4148-a7ad-896b64927530', '6982f209-3b67-49d7-a670-9c4e4bd41860'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Delete snapshot completed successfully. Jul 09 15:19:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6deccbf8-2bba-4437-99cc-a23cf6d87d5c tempest-TestStampPattern-1758697979 None] Lock "cinder-7cb8338a-23e1-499a-a780-f5f7f084094f-delete_snapshot" released by "delete_snapshot" :: held 5.171s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb26ed3-d543-4fa3-8fe4-15e5d68d0b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07f3fa75-359b-4ff6-8e55-43b2de91d0b1', 'volume_name': 'volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ba4f31-3b2c-46ab-8e1c-cf46898efec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ba4f31-3b2c-46ab-8e1c-cf46898efec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9288e39b-31e3-4a69-acb3-e51c1ba30501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Volume 07f3fa75-359b-4ff6-8e55-43b2de91d0b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 15:19:55 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Trying to clone 07f3fa75-359b-4ff6-8e55-43b2de91d0b1 from image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]). {{(pid=87042) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:19:55 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:19:55 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Image download 20.69 MB at 20.69 MB/s Jul 09 15:19:55 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb217ed-bb59-4917-9fee-d874bff40d71]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:55 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD Jul 09 15:19:55 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:56 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD" returned: 0 in 1.209s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:56 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Temporary image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 is fetched for user 3214856cc72b4bfa9b205873c3940a8c. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:19:57 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b1f210-7850-4680-9d60-8e14bfd6e5fc]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:57 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD Jul 09 15:19:57 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:58 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD" returned: 0 in 1.421s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-489616627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f3fa75-359b-4ff6-8e55-43b2de91d0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4308c1ccd74f9b8a4be5aa615c847f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:54Z,use_quota=True,user_id='3214856cc72b4bfa9b205873c3940a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Creating volume 07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:58 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:19:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:58 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 1073741824 Jul 09 15:19:58 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Flow 'volume_create_manager' (ae916d71-9a71-49ba-8b70-14d24707b56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e8c621-1d04-4098-93ab-f7e7cd8bfac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e8c621-1d04-4098-93ab-f7e7cd8bfac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1595153301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d71fad-281c-4b07-af07-bf0d10e4b541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c6ff3812c3423bae54b32351c51146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:59Z,use_quota=True,user_id='78e29945adeb43448e43da46e8fa0de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b803c800-f30e-4562-867e-cc09966d3244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b803c800-f30e-4562-867e-cc09966d3244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36802cc-c3b0-4e96-b870-69e04616c366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36802cc-c3b0-4e96-b870-69e04616c366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12d71fad-281c-4b07-af07-bf0d10e4b541', 'volume_name': 'volume-12d71fad-281c-4b07-af07-bf0d10e4b541', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e00a08c-07a4-4fcf-876c-5f3b48b16efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e00a08c-07a4-4fcf-876c-5f3b48b16efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39043d1-cd7a-40ed-9e7c-fae0081ffd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:59 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Volume 12d71fad-281c-4b07-af07-bf0d10e4b541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12d71fad-281c-4b07-af07-bf0d10e4b541', 'volume_size': 1} Jul 09 15:19:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:00 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 1073741824" returned: 0 in 1.724s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:00 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 Jul 09 15:20:00 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:01 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" returned: 0 in 1.063s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] <== create_volume: return (2881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.887s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.915s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1595153301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d71fad-281c-4b07-af07-bf0d10e4b541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c6ff3812c3423bae54b32351c51146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:59Z,use_quota=True,user_id='78e29945adeb43448e43da46e8fa0de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Creating volume 12d71fad-281c-4b07-af07-bf0d10e4b541 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:01 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Attempting download of 20626a8f-3a07-432c-b5dc-bd2614fa7a84 ((None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}])) to volume 07f3fa75-359b-4ff6-8e55-43b2de91d0b1. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:20:01 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 1073741824 Jul 09 15:20:01 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bb86bf-58f3-48c7-876c-1f6ac7a522f5]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ewwqw0hj {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:01 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ewwqw0hj Jul 09 15:20:01 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:02 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ewwqw0hj" returned: 0 in 1.181s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ewwqw0hj {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:02 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ewwqw0hj Jul 09 15:20:02 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:02 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 1073741824" returned: 0 in 1.515s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:03 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 Jul 09 15:20:03 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:04 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ewwqw0hj" returned: 1 in 1.289s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ewwqw0hj' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[db90cb0f-305c-4ef9-b407-697311db77b5]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:04 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD Jul 09 15:20:04 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:04 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541" returned: 0 in 1.262s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] <== create_volume: return (2878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.890s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39043d1-cd7a-40ed-9e7c-fae0081ffd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d71fad-281c-4b07-af07-bf0d10e4b541', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab2c4d0-62fe-4759-9aeb-b13febe1ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:04 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Volume volume-12d71fad-281c-4b07-af07-bf0d10e4b541 (12d71fad-281c-4b07-af07-bf0d10e4b541): created successfully Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab2c4d0-62fe-4759-9aeb-b13febe1ae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Flow 'volume_create_manager' (ae916d71-9a71-49ba-8b70-14d24707b56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:04 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-df38c5f8-9483-4bfb-bcd3-ffa96d8e40c2 tempest-TestMinimumBasicScenario-1305752149 None] Created volume successfully. Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:04 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:20:04 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Acquiring lock "cinder-18781141-a144-4529-94f6-3ff4a253bc5a-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Lock "cinder-18781141-a144-4529-94f6-3ff4a253bc5a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:05 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD" returned: 0 in 1.167s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:05 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] 20626a8f-3a07-432c-b5dc-bd2614fa7a84 was qcow2, converting to raw {{(pid=87042) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:20:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Acquiring lock "cinder-quobyte-18781141-a144-4529-94f6-3ff4a253bc5a" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-18781141-a144-4529-94f6-3ff4a253bc5a" acquired by "delete_volume" :: waited 0.036s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:05 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 Jul 09 15:20:05 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:05 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d9a60a-b9b0-404e-9d49-2ea18dd72fa0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:05 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a Jul 09 15:20:05 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:06 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.524s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:06 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:06 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:20:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:20:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:20:06 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a" returned: 0 in 1.432s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:06 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a Jul 09 15:20:06 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:07 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18781141-a144-4529-94f6-3ff4a253bc5a" returned: 0 in 1.041s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Lock "cinder-quobyte-18781141-a144-4529-94f6-3ff4a253bc5a" released by "delete_volume" :: held 2.605s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:07 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Created reservations ['8108640c-2b33-4bae-bfe4-a6fe24f6eaf6', '531cc502-6c83-49d5-8a69-d411c31da282', 'c8a16fb3-b2c5-45e6-9e14-92d528afeee3', 'f2d3b61f-1f91-4cef-a6e8-4f1701c4dc95'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:08 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:20:08 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-0200a939-1642-43fd-84fb-976f1edc316c req-c37bffd7-da23-4523-9608-36071ba5aa36 tempest-TestMinimumBasicScenario-1305752149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-0200a939-1642-43fd-84fb-976f1edc316c req-c37bffd7-da23-4523-9608-36071ba5aa36 tempest-TestMinimumBasicScenario-1305752149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff48806-30ea-4f2a-8772-4b93691555eb]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0200a939-1642-43fd-84fb-976f1edc316c req-c37bffd7-da23-4523-9608-36071ba5aa36 tempest-TestMinimumBasicScenario-1305752149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:08 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" returned: 0 in 3.160s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20626a8f-3a07-432c-b5dc-bd2614fa7a84_ew_uwuvsdevstack@QuobyteHD, size 112.00 MB, duration 3.16 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:20:08 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Converted 112.00 MB image at 35.43 MB/s Jul 09 15:20:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:08 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 Jul 09 15:20:08 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:08 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 1G Jul 09 15:20:08 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:09 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.978s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:09 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Deleted volume successfully. Jul 09 15:20:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-57e68b9b-4ce8-4bbf-a56d-0a49ca2d4a58 tempest-TestStampPattern-1758697979 None] Lock "cinder-18781141-a144-4529-94f6-3ff4a253bc5a-delete_volume" released by "delete_volume" :: held 3.969s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:09 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-0200a939-1642-43fd-84fb-976f1edc316c req-c37bffd7-da23-4523-9608-36071ba5aa36 tempest-TestMinimumBasicScenario-1305752149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541" returned: 0 in 1.025s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-0200a939-1642-43fd-84fb-976f1edc316c req-c37bffd7-da23-4523-9608-36071ba5aa36 tempest-TestMinimumBasicScenario-1305752149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.047s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-0200a939-1642-43fd-84fb-976f1edc316c req-c37bffd7-da23-4523-9608-36071ba5aa36 tempest-TestMinimumBasicScenario-1305752149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-12d71fad-281c-4b07-af07-bf0d10e4b541', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc34ddee-7f47-4876-8949-bb3a85fc1610', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:20:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-0200a939-1642-43fd-84fb-976f1edc316c req-c37bffd7-da23-4523-9608-36071ba5aa36 tempest-TestMinimumBasicScenario-1305752149 None] attachment_update completed successfully. Jul 09 15:20:09 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 1G" returned: 0 in 1.113s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:09 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23f9bfb-e888-4276-8dcc-253e0e7d0489]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:09 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 Jul 09 15:20:09 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:10 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" returned: 0 in 0.952s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:10 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 Jul 09 15:20:10 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:11 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" returned: 1 in 0.933s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Downloaded image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 ((None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}])) to volume 07f3fa75-359b-4ff6-8e55-43b2de91d0b1 successfully. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Temporary image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 for user 3214856cc72b4bfa9b205873c3940a8c is deleted. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Marking volume 07f3fa75-359b-4ff6-8e55-43b2de91d0b1 as bootable. {{(pid=87042) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Copying metadata from image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 to 07f3fa75-359b-4ff6-8e55-43b2de91d0b1. {{(pid=87042) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Creating volume glance metadata for volume 07f3fa75-359b-4ff6-8e55-43b2de91d0b1 backed by image 20626a8f-3a07-432c-b5dc-bd2614fa7a84 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87042) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9288e39b-31e3-4a69-acb3-e51c1ba30501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1', 'volume_size': 1, 'image_id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '586f4a489750480bacf5548337fa1f37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20626a8f-3a07-432c-b5dc-bd2614fa7a84', 'created_at': datetime.datetime(2026, 7, 9, 12, 59, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 59, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20626a8f-3a07-432c-b5dc-bd2614fa7a84/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4564b3f7-cf64-40bb-8840-66ed362ee9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:11 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Volume volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 (07f3fa75-359b-4ff6-8e55-43b2de91d0b1): created successfully Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4564b3f7-cf64-40bb-8840-66ed362ee9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Flow 'volume_create_manager' (329cd47e-f13f-45d4-a703-22cf1ca0d329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c50e1bb1-90f2-4715-93e6-a621d0bc21f3 tempest-VolumesExtendTest-1101662105 None] Created volume successfully. Jul 09 15:20:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:12 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3990375-5977-4f49-812a-bf45fa8c9b11]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:12 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 Jul 09 15:20:12 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:13 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" returned: 0 in 1.026s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:13 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 Jul 09 15:20:13 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:14 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" returned: 1 in 0.926s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 2G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 2G" returned: 0 in 0.088s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.095s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-222f7ac3-3aef-4499-b154-d54db2553f22 tempest-VolumesExtendTest-1101662105 None] Extend volume completed successfully. Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "cinder-07f3fa75-359b-4ff6-8e55-43b2de91d0b1-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Lock "cinder-07f3fa75-359b-4ff6-8e55-43b2de91d0b1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "cinder-quobyte-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Lock "cinder-quobyte-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b7310-7ca0-4203-b7a3-896bb285b2ed]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:14 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 Jul 09 15:20:14 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:15 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" returned: 0 in 0.902s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:15 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 Jul 09 15:20:15 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:16 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" returned: 1 in 0.860s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:16 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1 Jul 09 15:20:16 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:17 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" returned: 0 in 0.856s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Lock "cinder-quobyte-07f3fa75-359b-4ff6-8e55-43b2de91d0b1" released by "delete_volume" :: held 2.698s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:17 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Created reservations ['f1cd0950-a88c-4561-98ec-c8f245bb82fb', '949e7042-f2d2-4731-95f8-fe29ccc5b546', '1a8e53a1-95d5-4ede-bd26-bf8e4222ade8', '36a84748-69c1-4109-80f4-6607179da3ed'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:17 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:20:17 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Flow 'volume_create_manager' (f5398f22-f943-4c3c-bd07-93f5b121f3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2ffa6d-1ab4-46eb-bafb-dbba9f701039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2ffa6d-1ab4-46eb-bafb-dbba9f701039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-288729434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4308c1ccd74f9b8a4be5aa615c847f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:19Z,use_quota=True,user_id='3214856cc72b4bfa9b205873c3940a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9913db-0c7a-4388-89bd-c30bf4afce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9913db-0c7a-4388-89bd-c30bf4afce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b1664a-59c9-4822-a77a-a8464cc8e732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b1664a-59c9-4822-a77a-a8464cc8e732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a', 'volume_name': 'volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572f6598-126f-4b68-a2fd-cea9ec332e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572f6598-126f-4b68-a2fd-cea9ec332e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0255a974-3312-487a-8419-3a090deddb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:18 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Volume 79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a', 'volume_size': 1} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:18 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-288729434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4308c1ccd74f9b8a4be5aa615c847f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:19Z,use_quota=True,user_id='3214856cc72b4bfa9b205873c3940a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Creating volume 79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:18 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.323s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:18 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Deleted volume successfully. Jul 09 15:20:18 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a 1073741824 Jul 09 15:20:18 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a5959ff1-c977-4586-bb73-7fa17513af23 tempest-VolumesExtendTest-1101662105 None] Lock "cinder-07f3fa75-359b-4ff6-8e55-43b2de91d0b1-delete_volume" released by "delete_volume" :: held 4.302s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:20 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a 1073741824" returned: 0 in 1.287s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:20 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a Jul 09 15:20:20 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:21 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" returned: 0 in 0.928s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0255a974-3312-487a-8419-3a090deddb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5293ee-a381-4dfc-8cdf-7eaa1981a2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Volume volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a (79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a): created successfully Jul 09 15:20:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5293ee-a381-4dfc-8cdf-7eaa1981a2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Flow 'volume_create_manager' (f5398f22-f943-4c3c-bd07-93f5b121f3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:21 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-acecb3ec-7c12-47c4-a304-6fe3ffd8b5d4 tempest-VolumesExtendTest-1101662105 None] Created volume successfully. Jul 09 15:20:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Creating offline snapshot cfa1509e-794d-4f64-97c8-f198bbe21337 of volume 79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:20:22 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[353bdf11-f77b-41c9-95c1-9e1a1c298026]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:22 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a Jul 09 15:20:22 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:23 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" returned: 0 in 1.004s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:23 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 1G Jul 09 15:20:23 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:24 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 1G" returned: 0 in 1.174s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:24 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 Jul 09 15:20:24 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:25 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337" returned: 0 in 0.854s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:25 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 is being set with open permissions: ugo+rw Jul 09 15:20:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:25 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 Jul 09 15:20:25 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:25 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337" returned: 0 in 0.741s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:25 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=83,cinder:INSERT=29,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:20:25 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:INSERT=27,cinder:UPDATE=87,cinder:SELECT=81,cinder:DELETE=5 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:20:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:26 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.info Jul 09 15:20:26 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:26 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.info" returned: 0 in 0.809s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:26 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.info is being set with open permissions: ugo+rw Jul 09 15:20:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:26 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.info Jul 09 15:20:26 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:27 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.info" returned: 0 in 0.711s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.426s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:27 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c2546508-4153-4862-8bbe-22e0e35050cc tempest-VolumesExtendTest-1101662105 None] Create snapshot completed successfully Jul 09 15:20:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cae738e5-7ae5-4ea7-ad0b-43596ccf4ead tempest-VolumesExtendTest-1101662105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cae738e5-7ae5-4ea7-ad0b-43596ccf4ead tempest-VolumesExtendTest-1101662105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0a21e6-1895-4558-b6cb-5cde2ff0c1d9]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cae738e5-7ae5-4ea7-ad0b-43596ccf4ead tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:28 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a Jul 09 15:20:28 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Flow 'volume_create_manager' (98322917-bb8f-4acd-83cb-4a03901761b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a47eba-7d6c-4b34-a975-1ccc73663014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a47eba-7d6c-4b34-a975-1ccc73663014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606113897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf888824-46f4-41d0-898b-a635b02e04c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b8f461d7c14649a23e89965b3acb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:30Z,use_quota=True,user_id='da28dcde895740569605ccc0503ba66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6e4961-2dc1-4ccb-82ad-8d89b4b58ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6e4961-2dc1-4ccb-82ad-8d89b4b58ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e509dc-b996-4ed2-8df2-edf6754acdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e509dc-b996-4ed2-8df2-edf6754acdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf888824-46f4-41d0-898b-a635b02e04c0', 'volume_name': 'volume-bf888824-46f4-41d0-898b-a635b02e04c0', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083f06cd-aebb-4f60-bd82-ab71f79f5171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083f06cd-aebb-4f60-bd82-ab71f79f5171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c223c5-e8ba-4ed9-bf14-265d42153456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:29 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Volume bf888824-46f4-41d0-898b-a635b02e04c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf888824-46f4-41d0-898b-a635b02e04c0', 'volume_size': 1} Jul 09 15:20:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:30 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cae738e5-7ae5-4ea7-ad0b-43596ccf4ead tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" returned: 0 in 1.329s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cae738e5-7ae5-4ea7-ad0b-43596ccf4ead tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 2G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cae738e5-7ae5-4ea7-ad0b-43596ccf4ead tempest-VolumesExtendTest-1101662105 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 2G" returned: 0 in 0.189s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-cae738e5-7ae5-4ea7-ad0b-43596ccf4ead tempest-VolumesExtendTest-1101662105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.574s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606113897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf888824-46f4-41d0-898b-a635b02e04c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b8f461d7c14649a23e89965b3acb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:30Z,use_quota=True,user_id='da28dcde895740569605ccc0503ba66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Creating volume bf888824-46f4-41d0-898b-a635b02e04c0 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:30 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:20:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:30 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0 1073741824 Jul 09 15:20:30 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:30 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-cae738e5-7ae5-4ea7-ad0b-43596ccf4ead tempest-VolumesExtendTest-1101662105 None] Extend volume completed successfully. Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Acquiring lock "cinder-cfa1509e-794d-4f64-97c8-f198bbe21337-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Lock "cinder-cfa1509e-794d-4f64-97c8-f198bbe21337-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Acquiring lock "cinder-quobyte-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Lock "cinder-quobyte-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Acquiring lock "cinder-quobyte-cfa1509e-794d-4f64-97c8-f198bbe21337" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Lock "cinder-quobyte-cfa1509e-794d-4f64-97c8-f198bbe21337" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Deleting offline snapshot cfa1509e-794d-4f64-97c8-f198bbe21337 of volume 79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] snapshot_file for this snap is: volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aff9883-2661-4719-9938-09d0254b5db2]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:31 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0 1073741824" returned: 0 in 1.073s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:31 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 Jul 09 15:20:31 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:31 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0 Jul 09 15:20:31 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:32 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0" returned: 0 in 0.807s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c223c5-e8ba-4ed9-bf14-265d42153456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf888824-46f4-41d0-898b-a635b02e04c0', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581870b7-5d8e-4ba5-afa8-abbf53307e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:32 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Volume volume-bf888824-46f4-41d0-898b-a635b02e04c0 (bf888824-46f4-41d0-898b-a635b02e04c0): created successfully Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581870b7-5d8e-4ba5-afa8-abbf53307e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Flow 'volume_create_manager' (98322917-bb8f-4acd-83cb-4a03901761b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6105760e-26ea-4662-bc62-c1a13b9fa4e2 tempest-ProjectReaderTests-1506258912 None] Created volume successfully. Jul 09 15:20:32 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337" returned: 0 in 1.164s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd033ad-d29d-4b38-9e1a-dd48c91c070b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:32 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a Jul 09 15:20:32 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Acquiring lock "cinder-bf888824-46f4-41d0-898b-a635b02e04c0-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Lock "cinder-bf888824-46f4-41d0-898b-a635b02e04c0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Acquiring lock "cinder-quobyte-bf888824-46f4-41d0-898b-a635b02e04c0" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Lock "cinder-quobyte-bf888824-46f4-41d0-898b-a635b02e04c0" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50fa56a-1496-4bdc-8557-cd4a05533b6e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:33 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0 Jul 09 15:20:33 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:33 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" returned: 0 in 1.034s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:33 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 Jul 09 15:20:33 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:34 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0" returned: 0 in 1.043s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:34 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0 Jul 09 15:20:34 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:34 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337" returned: 0 in 1.048s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:34 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337 Jul 09 15:20:34 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:35 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf888824-46f4-41d0-898b-a635b02e04c0" returned: 0 in 0.877s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Lock "cinder-quobyte-bf888824-46f4-41d0-898b-a635b02e04c0" released by "delete_volume" :: held 1.970s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Created reservations ['a339db83-0e4c-4319-bf07-89d7a5a571b8', '0685a116-7c1d-4a7d-9f8c-309a1fb66e18', '58e41d1e-4c8e-45b3-a724-ace251adf6e8', '3e590ddd-f81f-433c-8ecf-64d30c3d4036'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:35 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:35 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a.cfa1509e-794d-4f64-97c8-f198bbe21337" returned: 0 in 0.853s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:35 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Lock "cinder-quobyte-cfa1509e-794d-4f64-97c8-f198bbe21337" released by "_delete_snapshot" :: held 4.230s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Lock "cinder-quobyte-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" released by "delete_snapshot" :: held 4.259s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Created reservations ['c6d92204-074c-4979-85c9-a28d70779ff7', 'ddf124d5-0dd4-422c-8902-7ce5c6618113', '47abf3f1-e90a-4064-af0a-b7730c34b776', '27f461ad-1386-4748-922e-41f26e365d53'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Delete snapshot completed successfully. Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-784c33e4-eb25-42a9-bf5a-f7ecadf081bc tempest-VolumesExtendTest-1101662105 None] Lock "cinder-cfa1509e-794d-4f64-97c8-f198bbe21337-delete_snapshot" released by "delete_snapshot" :: held 4.471s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Flow 'volume_create_manager' (519dc018-0e9e-4a66-8ee3-a98a9ee5accc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ebdb87-a719-49e7-9c80-9fd6646fb56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ebdb87-a719-49e7-9c80-9fd6646fb56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200901488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4677634-6cf2-4bf5-b243-6c66af0fbc0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b8f461d7c14649a23e89965b3acb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:36Z,use_quota=True,user_id='da28dcde895740569605ccc0503ba66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837b8f0a-0ccc-4020-8bc4-6a97ac09859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837b8f0a-0ccc-4020-8bc4-6a97ac09859f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7053ce75-c658-4f42-8a53-43df2c70c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7053ce75-c658-4f42-8a53-43df2c70c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4677634-6cf2-4bf5-b243-6c66af0fbc0d', 'volume_name': 'volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06abfdd-7512-4f83-a755-32fb21d03e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06abfdd-7512-4f83-a755-32fb21d03e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bf056a-b7a5-416b-bc32-6bd0be537b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:36 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Volume f4677634-6cf2-4bf5-b243-6c66af0fbc0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d', 'volume_size': 1} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200901488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4677634-6cf2-4bf5-b243-6c66af0fbc0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b8f461d7c14649a23e89965b3acb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:36Z,use_quota=True,user_id='da28dcde895740569605ccc0503ba66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Creating volume f4677634-6cf2-4bf5-b243-6c66af0fbc0d {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:36 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:36 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d 1073741824 Jul 09 15:20:36 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:36 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.751s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Deleted volume successfully. Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-4c273faf-7bc4-4fef-bacb-b7667f8c625b tempest-ProjectReaderTests-1506258912 None] Lock "cinder-bf888824-46f4-41d0-898b-a635b02e04c0-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "cinder-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Lock "cinder-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "cinder-quobyte-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Lock "cinder-quobyte-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef7dbf6-26b5-48b2-9070-ab42763351b0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:36 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a Jul 09 15:20:36 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:37 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d 1073741824" returned: 0 in 1.074s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:37 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d Jul 09 15:20:37 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:37 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" returned: 0 in 0.865s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:37 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a Jul 09 15:20:37 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:37 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d" returned: 0 in 0.741s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bf056a-b7a5-416b-bc32-6bd0be537b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22966dd8-eb1b-42dc-8097-3a43850bb9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:37 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Volume volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d (f4677634-6cf2-4bf5-b243-6c66af0fbc0d): created successfully Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22966dd8-eb1b-42dc-8097-3a43850bb9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Flow 'volume_create_manager' (519dc018-0e9e-4a66-8ee3-a98a9ee5accc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0b08e211-7ef0-4c09-9beb-7c5f1f16b930 tempest-ProjectReaderTests-1506258912 None] Created volume successfully. Jul 09 15:20:38 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" returned: 0 in 0.781s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Lock "cinder-quobyte-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a" released by "delete_volume" :: held 1.710s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:38 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Created reservations ['0d45ead6-341f-490f-aead-7f9fac60c79b', '448baac9-bb55-461f-bd28-155b9bd95259', '553845d9-ec2d-420b-a667-9cedc5ca2ef6', '43e69897-4969-4767-b2ca-dcb0842e2fa3'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:38 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:20:38 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Acquiring lock "cinder-f4677634-6cf2-4bf5-b243-6c66af0fbc0d-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Lock "cinder-f4677634-6cf2-4bf5-b243-6c66af0fbc0d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Acquiring lock "cinder-quobyte-f4677634-6cf2-4bf5-b243-6c66af0fbc0d" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Lock "cinder-quobyte-f4677634-6cf2-4bf5-b243-6c66af0fbc0d" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:39 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.924s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:39 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:39 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Deleted volume successfully. Jul 09 15:20:39 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[619e5708-e678-4953-b355-5086f50879f0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de4fca99-0309-484d-acf0-567009bccad2 tempest-VolumesExtendTest-1101662105 None] Lock "cinder-79bb5bda-33cd-46e4-8a9f-8ab71e6e0c2a-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:39 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d Jul 09 15:20:39 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:40 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d" returned: 0 in 0.853s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:40 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d Jul 09 15:20:40 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:41 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f4677634-6cf2-4bf5-b243-6c66af0fbc0d" returned: 0 in 0.835s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Lock "cinder-quobyte-f4677634-6cf2-4bf5-b243-6c66af0fbc0d" released by "delete_volume" :: held 1.808s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:41 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Created reservations ['a21bff35-e81a-4d19-8a19-4ffc054acaf1', '382d9811-fa4b-46d8-a83d-b9d5938ccac4', '99fe4eff-6ae6-43a9-860d-d38fb29ce333', 'bcbcfd43-a626-4083-8969-f586d30eabc6'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:41 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:20:41 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:42 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.761s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:42 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:42 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Deleted volume successfully. Jul 09 15:20:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a9185c5-0e19-4820-b3a4-8db4d9724f1d tempest-ProjectReaderTests-1506258912 None] Lock "cinder-f4677634-6cf2-4bf5-b243-6c66af0fbc0d-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:51 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=32,cinder:UPDATE=41,cinder:INSERT=9 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:20:52 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:DELETE=6,cinder:SELECT=23,cinder:UPDATE=37,cinder:INSERT=10 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Flow 'volume_create_manager' (d6ca8cb5-8aec-4498-b66d-72c92bc0ac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf26b4b4-cfff-4419-abc2-b433492b5d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf26b4b4-cfff-4419-abc2-b433492b5d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1506620606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24a8bc2-1654-4b76-bee6-448f375a434a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ad380892a42bba323b7a1c6f1c320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:56Z,use_quota=True,user_id='833f3c40292f401b98cdb95fd24d0f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028109c9-dda6-4f7a-856e-25dca570445d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028109c9-dda6-4f7a-856e-25dca570445d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff83e97-3275-4bb6-99dd-e240dfde76d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff83e97-3275-4bb6-99dd-e240dfde76d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f24a8bc2-1654-4b76-bee6-448f375a434a', 'volume_name': 'volume-f24a8bc2-1654-4b76-bee6-448f375a434a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9771bc-f147-4d9b-9afe-e82a316e3910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9771bc-f147-4d9b-9afe-e82a316e3910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a939ff8-b2fd-4f3b-bf43-c5c8919d3a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume f24a8bc2-1654-4b76-bee6-448f375a434a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f24a8bc2-1654-4b76-bee6-448f375a434a', 'volume_size': 1} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1506620606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24a8bc2-1654-4b76-bee6-448f375a434a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ad380892a42bba323b7a1c6f1c320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:56Z,use_quota=True,user_id='833f3c40292f401b98cdb95fd24d0f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Creating volume f24a8bc2-1654-4b76-bee6-448f375a434a {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:55 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:20:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:55 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a 1073741824 Jul 09 15:20:55 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:56 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a 1073741824" returned: 0 in 0.988s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:56 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a Jul 09 15:20:56 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:57 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a" returned: 0 in 0.782s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a939ff8-b2fd-4f3b-bf43-c5c8919d3a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24a8bc2-1654-4b76-bee6-448f375a434a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83decc9f-f124-464b-b11f-0f6114d091b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:57 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume volume-f24a8bc2-1654-4b76-bee6-448f375a434a (f24a8bc2-1654-4b76-bee6-448f375a434a): created successfully Jul 09 15:20:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83decc9f-f124-464b-b11f-0f6114d091b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Flow 'volume_create_manager' (d6ca8cb5-8aec-4498-b66d-72c92bc0ac8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:57 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b5c87e8a-869a-4260-a4fc-e815dfd53b89 tempest-VolumesSnapshotTestJSON-1505281318 None] Created volume successfully. Jul 09 15:20:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Creating offline snapshot 23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 of volume f24a8bc2-1654-4b76-bee6-448f375a434a {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:20:58 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f125d5d-33ed-4137-bf82-4d2c74a73746]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:58 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a Jul 09 15:20:58 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:59 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a" returned: 0 in 0.878s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:59 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 1G Jul 09 15:20:59 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:00 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 1G" returned: 0 in 0.938s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24a8bc2-1654-4b76-bee6-448f375a434a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:00 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24a8bc2-1654-4b76-bee6-448f375a434a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 Jul 09 15:21:00 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:00 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24a8bc2-1654-4b76-bee6-448f375a434a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04" returned: 0 in 0.808s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:00 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 is being set with open permissions: ugo+rw Jul 09 15:21:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:01 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 Jul 09 15:21:01 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:01 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04" returned: 0 in 0.730s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:01 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.info Jul 09 15:21:01 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:02 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.info" returned: 0 in 0.692s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:02 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.info is being set with open permissions: ugo+rw Jul 09 15:21:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:02 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.info Jul 09 15:21:02 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:03 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.info" returned: 0 in 0.673s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.845s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:03 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0374866f-cb4c-42a3-9991-61d622e201b4 tempest-VolumesSnapshotTestJSON-1505281318 None] Create snapshot completed successfully Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-f24a8bc2-1654-4b76-bee6-448f375a434a" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-f24a8bc2-1654-4b76-bee6-448f375a434a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Deleting offline snapshot 23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 of volume f24a8bc2-1654-4b76-bee6-448f375a434a {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] snapshot_file for this snap is: volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c6c897-fef1-4588-afc7-baa10b798639]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:03 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 Jul 09 15:21:03 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:04 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04" returned: 0 in 0.804s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f24a8bc2-1654-4b76-bee6-448f375a434a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0ad3b0-bc7b-4fe7-8b7f-1ccdf123acad]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:04 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a Jul 09 15:21:04 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:04 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:21:04 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:05 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a" returned: 0 in 0.787s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:05 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 Jul 09 15:21:05 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:05 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.703s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:21:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:21:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:21:06 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04" returned: 0 in 0.861s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:06 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04 Jul 09 15:21:06 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:07 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a.23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04" returned: 0 in 0.689s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04" released by "_delete_snapshot" :: held 3.258s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-f24a8bc2-1654-4b76-bee6-448f375a434a" released by "delete_snapshot" :: held 3.285s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:07 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Created reservations ['5302d482-94ec-4e17-a6bc-5b02a62e5db8', '3484a160-7b66-4289-a9cb-1e46ba56400c', 'e7e0e289-3dd7-413f-b787-68023ecd66da', '2859e543-fc94-482c-9232-929e512b9946'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:07 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Delete snapshot completed successfully. Jul 09 15:21:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eee8944-686a-4570-8ac9-40a17c1a0900 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-23f86d1d-d26c-42b7-a5f0-d7ba2cf0af04-delete_snapshot" released by "delete_snapshot" :: held 3.465s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Flow 'volume_create_manager' (2c4e8a24-195d-4527-aed4-3113eb4bfd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c1ca96-819d-434c-8044-7133ee063c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c1ca96-819d-434c-8044-7133ee063c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-219452684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0889f407-6557-451a-bef3-7fae9d87e447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ad380892a42bba323b7a1c6f1c320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:09Z,use_quota=True,user_id='833f3c40292f401b98cdb95fd24d0f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68957ad1-a57a-4bfe-a540-3b575870c237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68957ad1-a57a-4bfe-a540-3b575870c237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5c678c-a52c-4d04-b4c2-62c7b30a69ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5c678c-a52c-4d04-b4c2-62c7b30a69ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0889f407-6557-451a-bef3-7fae9d87e447', 'volume_name': 'volume-0889f407-6557-451a-bef3-7fae9d87e447', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630dfde4-3142-4514-bac4-6c2b45e0c6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630dfde4-3142-4514-bac4-6c2b45e0c6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e7a5af-acc3-4a5f-8339-afe2ad019298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:08 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Volume 0889f407-6557-451a-bef3-7fae9d87e447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0889f407-6557-451a-bef3-7fae9d87e447', 'volume_size': 1} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-219452684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0889f407-6557-451a-bef3-7fae9d87e447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ad380892a42bba323b7a1c6f1c320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:09Z,use_quota=True,user_id='833f3c40292f401b98cdb95fd24d0f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Creating volume 0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:21:08 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:21:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:08 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 1073741824 Jul 09 15:21:08 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:09 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 1073741824" returned: 0 in 0.840s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:09 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 Jul 09 15:21:09 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:10 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447" returned: 0 in 0.625s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e7a5af-acc3-4a5f-8339-afe2ad019298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0889f407-6557-451a-bef3-7fae9d87e447', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75848318-ecf5-4cb1-9257-67c9ef64a827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:10 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Volume volume-0889f407-6557-451a-bef3-7fae9d87e447 (0889f407-6557-451a-bef3-7fae9d87e447): created successfully Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75848318-ecf5-4cb1-9257-67c9ef64a827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Flow 'volume_create_manager' (2c4e8a24-195d-4527-aed4-3113eb4bfd12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:10 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b5c988bf-f061-496b-906e-a616094e9a8a tempest-VolumesSnapshotTestJSON-1505281318 None] Created volume successfully. Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Creating offline snapshot 4af4a787-ad3c-40bd-b90b-8b3c14006f6e of volume 0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3ac913-0760-4b5b-8b3d-3cee87ab03b4]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:10 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 Jul 09 15:21:10 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:11 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447" returned: 0 in 0.847s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:11 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e 1G Jul 09 15:21:11 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:12 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e 1G" returned: 0 in 0.861s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0889f407-6557-451a-bef3-7fae9d87e447 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:12 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0889f407-6557-451a-bef3-7fae9d87e447 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e Jul 09 15:21:12 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:13 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0889f407-6557-451a-bef3-7fae9d87e447 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e" returned: 0 in 0.685s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:13 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e is being set with open permissions: ugo+rw Jul 09 15:21:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:13 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e Jul 09 15:21:13 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:13 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e" returned: 0 in 0.675s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:13 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.info Jul 09 15:21:13 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-5bfd32a0-3a7b-43b0-a464-e9bc5b2430d8 req-67a20e34-af46-4cc2-8801-232231367c09 tempest-TestMinimumBasicScenario-1305752149 None] Terminate volume connection completed successfully. Jul 09 15:21:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-5bfd32a0-3a7b-43b0-a464-e9bc5b2430d8 req-67a20e34-af46-4cc2-8801-232231367c09 tempest-TestMinimumBasicScenario-1305752149 None] Deleting attachment bc34ddee-7f47-4876-8949-bb3a85fc1610. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:21:14 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.info" returned: 0 in 0.694s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:14 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.info is being set with open permissions: ugo+rw Jul 09 15:21:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:14 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.info Jul 09 15:21:14 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:15 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.info" returned: 0 in 0.668s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.543s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:15 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-318b8310-0eab-4cb8-9336-558d24bbb7c8 tempest-VolumesSnapshotTestJSON-1505281318 None] Create snapshot completed successfully Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Acquiring lock "cinder-12d71fad-281c-4b07-af07-bf0d10e4b541-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Lock "cinder-12d71fad-281c-4b07-af07-bf0d10e4b541-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Acquiring lock "cinder-quobyte-12d71fad-281c-4b07-af07-bf0d10e4b541" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Lock "cinder-quobyte-12d71fad-281c-4b07-af07-bf0d10e4b541" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[060cde06-c48c-4b61-b72b-f876fa7b59ec]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:16 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 Jul 09 15:21:16 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Flow 'volume_create_manager' (6457bfd7-01d1-49d1-8676-a2b4149ae17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b11219-0c34-4fcb-901e-f3cbc193b450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b11219-0c34-4fcb-901e-f3cbc193b450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-129105432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630daf74-6004-4500-8f39-c160607391a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ad380892a42bba323b7a1c6f1c320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4af4a787-ad3c-40bd-b90b-8b3c14006f6e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:17Z,use_quota=True,user_id='833f3c40292f401b98cdb95fd24d0f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08a5be9-be4b-47b7-a213-6904428ab9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08a5be9-be4b-47b7-a213-6904428ab9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62cb7011-aeff-41ee-b322-560f6fd981d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62cb7011-aeff-41ee-b322-560f6fd981d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '630daf74-6004-4500-8f39-c160607391a2', 'volume_name': 'volume-630daf74-6004-4500-8f39-c160607391a2', 'volume_size': 2, 'snapshot_id': '4af4a787-ad3c-40bd-b90b-8b3c14006f6e'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9ef472-a952-4233-af44-033ba5cb6467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9ef472-a952-4233-af44-033ba5cb6467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96fce58-2e03-4178-a32b-8ad1c48e88f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:16 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume 630daf74-6004-4500-8f39-c160607391a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-630daf74-6004-4500-8f39-c160607391a2', 'volume_size': 2, 'snapshot_id': '4af4a787-ad3c-40bd-b90b-8b3c14006f6e'} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-4af4a787-ad3c-40bd-b90b-8b3c14006f6e-630daf74-6004-4500-8f39-c160607391a2" by "_create_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-4af4a787-ad3c-40bd-b90b-8b3c14006f6e-630daf74-6004-4500-8f39-c160607391a2" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Creating volume 630daf74-6004-4500-8f39-c160607391a2 from snapshot 4af4a787-ad3c-40bd-b90b-8b3c14006f6e {{(pid=87042) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-630daf74-6004-4500-8f39-c160607391a2" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-630daf74-6004-4500-8f39-c160607391a2" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] snapshot: 4af4a787-ad3c-40bd-b90b-8b3c14006f6e, volume: 630daf74-6004-4500-8f39-c160607391a2, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a2780e-ea64-4f5c-b2c2-fe4f0e11592a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:17 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e Jul 09 15:21:17 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:17 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541" returned: 0 in 0.906s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:17 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541 Jul 09 15:21:17 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:17 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e" returned: 0 in 0.848s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0889f407-6557-451a-bef3-7fae9d87e447(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:21:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:21:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:21:17 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79c6dc8-81be-4237-b45a-1f490bc68a3c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:17 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 Jul 09 15:21:17 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:17 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-12d71fad-281c-4b07-af07-bf0d10e4b541" returned: 0 in 0.720s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Lock "cinder-quobyte-12d71fad-281c-4b07-af07-bf0d10e4b541" released by "delete_volume" :: held 1.691s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Created reservations ['4b73849e-dcea-4cc2-a40d-2a4143b18743', '877712f5-44d5-4fd4-bcf6-c3a91b7ba47f', '5e044522-d425-4f76-a6c0-4000fa842be8', '1ccbc0e5-0134-4c9a-b554-d043a8deb943'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:18 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:21:18 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:18 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447" returned: 0 in 0.863s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:18 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 Jul 09 15:21:18 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:18 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.725s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:18 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Deleted volume successfully. Jul 09 15:21:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a3a538a4-f0f0-4503-9889-51428d70a8f4 tempest-TestMinimumBasicScenario-1305752149 None] Lock "cinder-12d71fad-281c-4b07-af07-bf0d10e4b541-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Flow 'volume_create_manager' (fb2fa8db-ab3b-458f-adfb-8c5c3968ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dba0cd-0edb-4126-b970-488e4d14d456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dba0cd-0edb-4126-b970-488e4d14d456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1007119229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752d4cea-c620-4005-9e13-cc7a052daecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf11a551ff94ab3bcb8c1fc6375d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:23Z,use_quota=True,user_id='1461a704a6454f7789378c32a5d63953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f42e5c-7b65-408d-a2b6-24657d427c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f42e5c-7b65-408d-a2b6-24657d427c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0774a3fb-7500-42f7-9a9c-48f244b556b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0774a3fb-7500-42f7-9a9c-48f244b556b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752d4cea-c620-4005-9e13-cc7a052daecb', 'volume_name': 'volume-752d4cea-c620-4005-9e13-cc7a052daecb', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07905c83-ce14-4ba7-ace8-a4aa3e20d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07905c83-ce14-4ba7-ace8-a4aa3e20d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfcc2fa-d27e-4118-a817-c087c32886c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Volume 752d4cea-c620-4005-9e13-cc7a052daecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752d4cea-c620-4005-9e13-cc7a052daecb', 'volume_size': 1} Jul 09 15:21:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:24 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2" returned: 0 in 6.002s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:24 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[229f01b7-c408-4a09-8ebb-711ce5bbc74a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:24 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 Jul 09 15:21:24 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:25 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447" returned: 0 in 0.926s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:25 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:21:25 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Converted 1024.00 MB image at 170.59 MB/s Jul 09 15:21:25 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 is being set with open permissions: ugo+rw Jul 09 15:21:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:25 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 Jul 09 15:21:25 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:26 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2" returned: 0 in 0.636s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-630daf74-6004-4500-8f39-c160607391a2" released by "_copy_volume_from_snapshot" :: held 9.392s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-4af4a787-ad3c-40bd-b90b-8b3c14006f6e-630daf74-6004-4500-8f39-c160607391a2" released by "_create_volume_from_snapshot" :: held 9.440s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.468s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.817s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1007119229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752d4cea-c620-4005-9e13-cc7a052daecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf11a551ff94ab3bcb8c1fc6375d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:23Z,use_quota=True,user_id='1461a704a6454f7789378c32a5d63953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Creating volume 752d4cea-c620-4005-9e13-cc7a052daecb {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:21:26 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:26 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb 1073741824 Jul 09 15:21:26 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96fce58-2e03-4178-a32b-8ad1c48e88f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630daf74-6004-4500-8f39-c160607391a2', 'volume_size': 2, 'snapshot_id': '4af4a787-ad3c-40bd-b90b-8b3c14006f6e'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a0f9e2-c623-4b61-871c-2014501f1660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:26 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume volume-630daf74-6004-4500-8f39-c160607391a2 (630daf74-6004-4500-8f39-c160607391a2): created successfully Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a0f9e2-c623-4b61-871c-2014501f1660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Flow 'volume_create_manager' (6457bfd7-01d1-49d1-8676-a2b4149ae17a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-98cbc37b-339a-4410-976e-bd84435323f5 tempest-VolumesSnapshotTestJSON-1505281318 None] Created volume successfully. Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-630daf74-6004-4500-8f39-c160607391a2-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-630daf74-6004-4500-8f39-c160607391a2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-630daf74-6004-4500-8f39-c160607391a2" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-630daf74-6004-4500-8f39-c160607391a2" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64cbbb9-a0a4-492d-a982-80e1db5a93bb]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:26 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 Jul 09 15:21:26 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:27 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb 1073741824" returned: 0 in 0.899s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:27 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb Jul 09 15:21:27 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:27 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2" returned: 0 in 0.861s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:27 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2 Jul 09 15:21:27 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:27 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb" returned: 0 in 0.747s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfcc2fa-d27e-4118-a817-c087c32886c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752d4cea-c620-4005-9e13-cc7a052daecb', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fef046-1222-4358-86dd-165f0051549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:27 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Volume volume-752d4cea-c620-4005-9e13-cc7a052daecb (752d4cea-c620-4005-9e13-cc7a052daecb): created successfully Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fef046-1222-4358-86dd-165f0051549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Flow 'volume_create_manager' (fb2fa8db-ab3b-458f-adfb-8c5c3968ae20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:28 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-928b6db8-39ff-45b3-bf4a-bd638f7335af tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Created volume successfully. Jul 09 15:21:28 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-630daf74-6004-4500-8f39-c160607391a2" returned: 0 in 0.715s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-630daf74-6004-4500-8f39-c160607391a2" released by "delete_volume" :: held 1.627s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:28 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Created reservations ['ed029586-dbc2-4c24-a65c-91c2490c9604', '8d618018-5e8c-4354-8d63-9d02f3bbc796', 'd93adab3-2087-44d9-b634-c86b7a760177', '2f140f3b-00db-451a-b019-8108fb719bcb'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:28 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:21:28 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-4af4a787-ad3c-40bd-b90b-8b3c14006f6e-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-4af4a787-ad3c-40bd-b90b-8b3c14006f6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-0889f407-6557-451a-bef3-7fae9d87e447" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-0889f407-6557-451a-bef3-7fae9d87e447" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-4af4a787-ad3c-40bd-b90b-8b3c14006f6e" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-4af4a787-ad3c-40bd-b90b-8b3c14006f6e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Deleting offline snapshot 4af4a787-ad3c-40bd-b90b-8b3c14006f6e of volume 0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] snapshot_file for this snap is: volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d311d55-86e2-4fb7-8b12-bff25a4d7d7d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:29 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e Jul 09 15:21:29 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:29 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.754s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:29 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Deleted volume successfully. Jul 09 15:21:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e94881f3-fe6e-4c51-8bc2-44d2181df2b3 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-630daf74-6004-4500-8f39-c160607391a2-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:30 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e" returned: 0 in 0.944s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0889f407-6557-451a-bef3-7fae9d87e447(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:21:30 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[393214b0-94eb-46f1-986d-7d94e1e72265]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:30 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 Jul 09 15:21:30 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:30 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447" returned: 0 in 0.792s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:30 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e Jul 09 15:21:30 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:31 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e" returned: 0 in 0.851s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:31 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e Jul 09 15:21:31 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-58de4f58-f25f-437d-8d4a-a22b140fa389 req-f5b0a3fd-9391-4438-a14a-2e83e2a740da tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-58de4f58-f25f-437d-8d4a-a22b140fa389 req-f5b0a3fd-9391-4438-a14a-2e83e2a740da tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cad7f4-ea94-4353-b03e-1a25c9f8a9c0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-58de4f58-f25f-437d-8d4a-a22b140fa389 req-f5b0a3fd-9391-4438-a14a-2e83e2a740da tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:31 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb Jul 09 15:21:31 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:32 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447.4af4a787-ad3c-40bd-b90b-8b3c14006f6e" returned: 0 in 0.721s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-4af4a787-ad3c-40bd-b90b-8b3c14006f6e" released by "_delete_snapshot" :: held 3.444s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-0889f407-6557-451a-bef3-7fae9d87e447" released by "delete_snapshot" :: held 3.471s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:32 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Created reservations ['7e4a4f93-a9bc-4d8b-a9d1-971f0bfc59e4', '50375475-971f-4ede-9f96-79c73828290c', 'a85c8de4-13d8-4f02-833e-eb20e674ba88', '3c318754-3fe0-4eb8-b65d-f91d5f0c3daf'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Delete snapshot completed successfully. Jul 09 15:21:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-64df94d1-f3c3-4b1d-ab10-f99426748f7f tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-4af4a787-ad3c-40bd-b90b-8b3c14006f6e-delete_snapshot" released by "delete_snapshot" :: held 3.624s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:32 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-58de4f58-f25f-437d-8d4a-a22b140fa389 req-f5b0a3fd-9391-4438-a14a-2e83e2a740da tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb" returned: 0 in 0.871s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-58de4f58-f25f-437d-8d4a-a22b140fa389 req-f5b0a3fd-9391-4438-a14a-2e83e2a740da tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.892s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-58de4f58-f25f-437d-8d4a-a22b140fa389 req-f5b0a3fd-9391-4438-a14a-2e83e2a740da tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-752d4cea-c620-4005-9e13-cc7a052daecb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0cb92b5-1e36-4329-bf4e-f8ee60fb1e2c', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:21:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-58de4f58-f25f-437d-8d4a-a22b140fa389 req-f5b0a3fd-9391-4438-a14a-2e83e2a740da tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] attachment_update completed successfully. Jul 09 15:21:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-0889f407-6557-451a-bef3-7fae9d87e447-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-0889f407-6557-451a-bef3-7fae9d87e447-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-0889f407-6557-451a-bef3-7fae9d87e447" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-0889f407-6557-451a-bef3-7fae9d87e447" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efd2302-cc6b-4ae8-9cb6-59c03dc351e5]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:33 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 Jul 09 15:21:33 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:34 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447" returned: 0 in 0.860s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:34 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447 Jul 09 15:21:34 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:35 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0889f407-6557-451a-bef3-7fae9d87e447" returned: 0 in 0.684s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-0889f407-6557-451a-bef3-7fae9d87e447" released by "delete_volume" :: held 1.623s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Created reservations ['86823d70-53a1-4be4-a793-4897c1040f8c', 'b1c52bd9-57ac-410b-b58a-0f2c7b27f9d5', '97badc8d-5f68-4905-9324-9f3cd7f55d1b', '3f9bba94-11c3-434f-9283-2372c67eecb5'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:35 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:21:35 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:35 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.719s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:35 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Deleted volume successfully. Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3b06a17b-25fd-4e92-8d21-79449d9025e0 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-0889f407-6557-451a-bef3-7fae9d87e447-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Flow 'volume_create_manager' (993cf596-a023-47c0-81cc-6f30cc5bbd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6777fb57-3770-4247-b39e-e8b6d5c18773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6777fb57-3770-4247-b39e-e8b6d5c18773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-342043595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c336df8-5174-4424-a6e4-1b6de658726d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ad380892a42bba323b7a1c6f1c320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:36Z,use_quota=True,user_id='833f3c40292f401b98cdb95fd24d0f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fec620-c4fd-4d8e-9838-a6a697df81af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fec620-c4fd-4d8e-9838-a6a697df81af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4ecc9a-0bf2-4c77-925f-b5bf85c9ed74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4ecc9a-0bf2-4c77-925f-b5bf85c9ed74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c336df8-5174-4424-a6e4-1b6de658726d', 'volume_name': 'volume-6c336df8-5174-4424-a6e4-1b6de658726d', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa718ee-7076-42ad-83c7-ce37bf3cd96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa718ee-7076-42ad-83c7-ce37bf3cd96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e545100-d3da-43cb-9d08-7b8697ffc8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:36 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume 6c336df8-5174-4424-a6e4-1b6de658726d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c336df8-5174-4424-a6e4-1b6de658726d', 'volume_size': 1} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-342043595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c336df8-5174-4424-a6e4-1b6de658726d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ad380892a42bba323b7a1c6f1c320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:36Z,use_quota=True,user_id='833f3c40292f401b98cdb95fd24d0f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Creating volume 6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:21:36 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:21:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:36 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d 1073741824 Jul 09 15:21:36 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:37 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d 1073741824" returned: 0 in 0.927s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:37 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d Jul 09 15:21:37 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:37 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d" returned: 0 in 0.660s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:21:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e545100-d3da-43cb-9d08-7b8697ffc8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c336df8-5174-4424-a6e4-1b6de658726d', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd91fe3-ad5b-4fbb-8028-a6caf85ae841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:38 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume volume-6c336df8-5174-4424-a6e4-1b6de658726d (6c336df8-5174-4424-a6e4-1b6de658726d): created successfully Jul 09 15:21:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd91fe3-ad5b-4fbb-8028-a6caf85ae841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Flow 'volume_create_manager' (993cf596-a023-47c0-81cc-6f30cc5bbd37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:38 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9e53bfaf-ebf7-40dd-8ed8-77a13ddbb209 tempest-VolumesSnapshotTestJSON-1505281318 None] Created volume successfully. Jul 09 15:21:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Creating offline snapshot 72dec3a3-bd8d-4c25-958f-33e7c3511995 of volume 6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:21:38 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[691f46b6-0dad-4c54-98b8-4163706cb543]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:38 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d Jul 09 15:21:38 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:39 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d" returned: 0 in 0.853s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:39 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 1G Jul 09 15:21:39 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:40 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 1G" returned: 0 in 0.867s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c336df8-5174-4424-a6e4-1b6de658726d -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:40 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c336df8-5174-4424-a6e4-1b6de658726d -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 Jul 09 15:21:40 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:40 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-69d516af-c58a-4c9b-b7f9-7b2d302974d3 req-25dedca8-b623-4cda-bffc-e0c8e998e2f2 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Terminate volume connection completed successfully. Jul 09 15:21:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-69d516af-c58a-4c9b-b7f9-7b2d302974d3 req-25dedca8-b623-4cda-bffc-e0c8e998e2f2 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Deleting attachment d0cb92b5-1e36-4329-bf4e-f8ee60fb1e2c. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:21:41 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c336df8-5174-4424-a6e4-1b6de658726d -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995" returned: 0 in 0.793s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:41 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 is being set with open permissions: ugo+rw Jul 09 15:21:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:41 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 Jul 09 15:21:41 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:41 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995" returned: 0 in 0.678s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:41 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.info Jul 09 15:21:41 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:42 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.info" returned: 0 in 0.783s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:42 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.info is being set with open permissions: ugo+rw Jul 09 15:21:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:42 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.info Jul 09 15:21:42 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Acquiring lock "cinder-752d4cea-c620-4005-9e13-cc7a052daecb-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "cinder-752d4cea-c620-4005-9e13-cc7a052daecb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Acquiring lock "cinder-quobyte-752d4cea-c620-4005-9e13-cc7a052daecb" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "cinder-quobyte-752d4cea-c620-4005-9e13-cc7a052daecb" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:43 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[0199656a-2663-4fd0-bed8-b15ae4bf8652]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:43 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb Jul 09 15:21:43 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:43 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.info" returned: 0 in 0.743s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.816s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:43 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a5f7d733-05f2-4282-ae5a-bfb9d29d8c0b tempest-VolumesSnapshotTestJSON-1505281318 None] Create snapshot completed successfully Jul 09 15:21:43 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb" returned: 0 in 0.832s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:43 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb Jul 09 15:21:43 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Flow 'volume_create_manager' (9e26f778-f663-4f38-bade-760e8e20b295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee14a1a4-4734-4945-bfa3-2c6261d9fcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee14a1a4-4734-4945-bfa3-2c6261d9fcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1669883278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80f73ee-d545-4cef-aa72-1ef09e1215f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ad380892a42bba323b7a1c6f1c320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72dec3a3-bd8d-4c25-958f-33e7c3511995,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:44Z,use_quota=True,user_id='833f3c40292f401b98cdb95fd24d0f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f044ab-633f-49ab-ba6c-3af2a0681446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f044ab-633f-49ab-ba6c-3af2a0681446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce98ca9a-6b01-43cf-9ca1-b6d5d1a102aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce98ca9a-6b01-43cf-9ca1-b6d5d1a102aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b80f73ee-d545-4cef-aa72-1ef09e1215f9', 'volume_name': 'volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9', 'volume_size': 1, 'snapshot_id': '72dec3a3-bd8d-4c25-958f-33e7c3511995'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28eb3606-8b79-4438-92c0-fea33adc6f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28eb3606-8b79-4438-92c0-fea33adc6f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a1c7c3-24a6-4b35-8e40-90f875a61fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:44 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume b80f73ee-d545-4cef-aa72-1ef09e1215f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9', 'volume_size': 1, 'snapshot_id': '72dec3a3-bd8d-4c25-958f-33e7c3511995'} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-72dec3a3-bd8d-4c25-958f-33e7c3511995-b80f73ee-d545-4cef-aa72-1ef09e1215f9" by "_create_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-72dec3a3-bd8d-4c25-958f-33e7c3511995-b80f73ee-d545-4cef-aa72-1ef09e1215f9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Creating volume b80f73ee-d545-4cef-aa72-1ef09e1215f9 from snapshot 72dec3a3-bd8d-4c25-958f-33e7c3511995 {{(pid=87042) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-b80f73ee-d545-4cef-aa72-1ef09e1215f9" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-b80f73ee-d545-4cef-aa72-1ef09e1215f9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] snapshot: 72dec3a3-bd8d-4c25-958f-33e7c3511995, volume: b80f73ee-d545-4cef-aa72-1ef09e1215f9, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a52ed4-7573-4817-986b-531b26bf74ad]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:44 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-752d4cea-c620-4005-9e13-cc7a052daecb" returned: 0 in 0.751s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "cinder-quobyte-752d4cea-c620-4005-9e13-cc7a052daecb" released by "delete_volume" :: held 1.642s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Created reservations ['1e228425-f1b9-46fd-855b-3180949a19a9', '0374abae-0898-482d-a889-c758ae6376d3', 'c4f4a991-f728-4d49-a95c-16a5cf391500', 'f995f7a7-4b22-4810-a644-69c4638a0a71'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:44 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 Jul 09 15:21:44 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:44 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:21:44 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:45 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995" returned: 0 in 0.966s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c336df8-5174-4424-a6e4-1b6de658726d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:21:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:21:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:21:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fcdcf1-d144-4fcc-aaee-81149308ada6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:45 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.823s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:45 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Deleted volume successfully. Jul 09 15:21:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c020247c-fbf6-4f43-bddd-b6b3ba0c9fc9 tempest-TestServerVolumeAttachScenarioOldVersion-131651434 None] Lock "cinder-752d4cea-c620-4005-9e13-cc7a052daecb-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:45 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d Jul 09 15:21:45 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:46 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d" returned: 0 in 0.845s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:46 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:21:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:46 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 Jul 09 15:21:46 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:53 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9" returned: 0 in 6.586s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:53 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1eb81d-5136-4664-bb6d-40e74097bdfa]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:53 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d Jul 09 15:21:53 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:54 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d" returned: 0 in 1.043s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:21:54 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Converted 1024.00 MB image at 155.46 MB/s Jul 09 15:21:54 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 is being set with open permissions: ugo+rw Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:54 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 Jul 09 15:21:54 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:54 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9" returned: 0 in 0.703s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-b80f73ee-d545-4cef-aa72-1ef09e1215f9" released by "_copy_volume_from_snapshot" :: held 10.264s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-72dec3a3-bd8d-4c25-958f-33e7c3511995-b80f73ee-d545-4cef-aa72-1ef09e1215f9" released by "_create_volume_from_snapshot" :: held 10.300s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.318s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=63,cinder:UPDATE=64,cinder:DELETE=8,cinder:INSERT=17 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=66,cinder:SELECT=74,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a1c7c3-24a6-4b35-8e40-90f875a61fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9', 'volume_size': 1, 'snapshot_id': '72dec3a3-bd8d-4c25-958f-33e7c3511995'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e78c111-106f-4cca-b5a9-0ae2e8da5607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:54 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Volume volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 (b80f73ee-d545-4cef-aa72-1ef09e1215f9): created successfully Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e78c111-106f-4cca-b5a9-0ae2e8da5607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Flow 'volume_create_manager' (9e26f778-f663-4f38-bade-760e8e20b295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-81970134-22f0-438f-a2b3-8988b975d240 tempest-VolumesSnapshotTestJSON-1505281318 None] Created volume successfully. Jul 09 15:21:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-b80f73ee-d545-4cef-aa72-1ef09e1215f9-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-b80f73ee-d545-4cef-aa72-1ef09e1215f9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-b80f73ee-d545-4cef-aa72-1ef09e1215f9" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-b80f73ee-d545-4cef-aa72-1ef09e1215f9" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:55 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6edad12-1a10-4383-b244-c93858fe6d3a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:55 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 Jul 09 15:21:55 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:56 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9" returned: 0 in 0.826s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:56 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9 Jul 09 15:21:56 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:57 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b80f73ee-d545-4cef-aa72-1ef09e1215f9" returned: 0 in 0.850s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-b80f73ee-d545-4cef-aa72-1ef09e1215f9" released by "delete_volume" :: held 1.740s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:57 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Created reservations ['29b7a752-d286-4da3-9e5a-bf884df15a73', '747ae9f4-eaa8-487a-aa32-0ce377e0660d', 'a8feba17-f219-47ae-8ce3-92214e18c227', '3f39bc04-b3d1-4b8f-bc8a-8af047afc387'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:57 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:21:57 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-72dec3a3-bd8d-4c25-958f-33e7c3511995-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-72dec3a3-bd8d-4c25-958f-33e7c3511995-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-6c336df8-5174-4424-a6e4-1b6de658726d" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-6c336df8-5174-4424-a6e4-1b6de658726d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-72dec3a3-bd8d-4c25-958f-33e7c3511995" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-72dec3a3-bd8d-4c25-958f-33e7c3511995" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Deleting offline snapshot 72dec3a3-bd8d-4c25-958f-33e7c3511995 of volume 6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] snapshot_file for this snap is: volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fb5470-09ec-4ba7-a8d9-2041193b72c6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:58 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 Jul 09 15:21:58 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:58 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.888s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:58 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Deleted volume successfully. Jul 09 15:21:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dbbe93b5-ef32-4193-9d23-1bfa2f536afb tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-b80f73ee-d545-4cef-aa72-1ef09e1215f9-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:59 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995" returned: 0 in 0.934s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c336df8-5174-4424-a6e4-1b6de658726d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:21:59 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4d7623-b101-488b-a7b4-40b0daaff035]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:59 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d Jul 09 15:21:59 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:00 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d" returned: 0 in 0.922s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:00 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 Jul 09 15:22:00 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:01 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995" returned: 0 in 0.947s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:01 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995 Jul 09 15:22:01 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:01 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d.72dec3a3-bd8d-4c25-958f-33e7c3511995" returned: 0 in 0.756s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-72dec3a3-bd8d-4c25-958f-33e7c3511995" released by "_delete_snapshot" :: held 3.692s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-6c336df8-5174-4424-a6e4-1b6de658726d" released by "delete_snapshot" :: held 3.724s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:01 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Created reservations ['2c114010-0f66-4bd3-a2ca-65be4bb6d965', '6ee6834e-11d5-4690-9c48-d41eaa514b49', 'f093e1b7-72ed-4ecc-aa4c-5e75f1670f24', '0b299d2d-e449-4453-850b-b2409ba757c4'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:01 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Delete snapshot completed successfully. Jul 09 15:22:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-849bb431-c03e-42d8-8d85-b54054865429 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-72dec3a3-bd8d-4c25-958f-33e7c3511995-delete_snapshot" released by "delete_snapshot" :: held 3.915s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-6c336df8-5174-4424-a6e4-1b6de658726d-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-6c336df8-5174-4424-a6e4-1b6de658726d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-6c336df8-5174-4424-a6e4-1b6de658726d" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-6c336df8-5174-4424-a6e4-1b6de658726d" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:02 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6053e6c4-fe1f-47ac-8a01-8553d9880853]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:02 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d Jul 09 15:22:02 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:03 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d" returned: 0 in 0.920s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:03 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d Jul 09 15:22:03 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Flow 'volume_create_manager' (6c4498df-4672-4bce-9ecf-419d3f5024e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4d8892-77f3-418a-ae71-5d6585cf5fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4d8892-77f3-418a-ae71-5d6585cf5fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1671290466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b562a6f-4213-4783-841e-9a38bc25bd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a3c232b39b49bf981e077d0239cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:04Z,use_quota=True,user_id='547991ec7a1043218a763d7262037672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98647d5f-dfce-4918-8ea3-9feeb9abaad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98647d5f-dfce-4918-8ea3-9feeb9abaad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2f0bdf-463b-4a56-8a61-a7bb6d0e0b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2f0bdf-463b-4a56-8a61-a7bb6d0e0b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b562a6f-4213-4783-841e-9a38bc25bd60', 'volume_name': 'volume-5b562a6f-4213-4783-841e-9a38bc25bd60', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0faac4c-6d05-457f-8575-0ebcde71a65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0faac4c-6d05-457f-8575-0ebcde71a65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7aee67b-869c-4b13-a897-2f702eaa669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:04 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Volume 5b562a6f-4213-4783-841e-9a38bc25bd60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b562a6f-4213-4783-841e-9a38bc25bd60', 'volume_size': 1} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1671290466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b562a6f-4213-4783-841e-9a38bc25bd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a3c232b39b49bf981e077d0239cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:04Z,use_quota=True,user_id='547991ec7a1043218a763d7262037672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Creating volume 5b562a6f-4213-4783-841e-9a38bc25bd60 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:04 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:04 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 1073741824 Jul 09 15:22:04 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:04 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c336df8-5174-4424-a6e4-1b6de658726d" returned: 0 in 0.911s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-6c336df8-5174-4424-a6e4-1b6de658726d" released by "delete_volume" :: held 1.948s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Created reservations ['79346b8c-b083-4035-ac97-e1e5994fe174', 'ed0fce5b-5d94-4f16-8a61-d50be1815e2c', '3340e0eb-243f-4fe9-b8ae-74596cc4e312', '2b86b88e-7d3c-4dac-98a8-e88e135ba981'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Flow 'volume_create_manager' (e5daea62-0577-4dde-8e54-4f708cbf5fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4729b0-6d4f-4ca3-aef9-1f6e7e67864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4729b0-6d4f-4ca3-aef9-1f6e7e67864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1377606175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a10687-baf8-449c-973f-b4cf7e1af8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a3c232b39b49bf981e077d0239cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:05Z,use_quota=True,user_id='547991ec7a1043218a763d7262037672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468ebb19-cc81-4ead-be77-300d5a682399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468ebb19-cc81-4ead-be77-300d5a682399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6494d730-c215-4337-b9e1-84da02cffa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6494d730-c215-4337-b9e1-84da02cffa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a10687-baf8-449c-973f-b4cf7e1af8d9', 'volume_name': 'volume-36a10687-baf8-449c-973f-b4cf7e1af8d9', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8251c11-5a8b-430e-8f12-7e16d7450ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8251c11-5a8b-430e-8f12-7e16d7450ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37d94e3-8bc3-461e-b379-599e4cd822a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:04 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Volume 36a10687-baf8-449c-973f-b4cf7e1af8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a10687-baf8-449c-973f-b4cf7e1af8d9', 'volume_size': 1} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:04 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:22:04 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:04 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:22:04 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:05 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 1073741824" returned: 0 in 1.391s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:05 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 Jul 09 15:22:05 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:05 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.884s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:05 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Deleted volume successfully. Jul 09 15:22:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b9890d94-ff3c-4d35-8e9b-ec212bf11b6e tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-6c336df8-5174-4424-a6e4-1b6de658726d-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:05 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.038s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:22:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:22:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-f24a8bc2-1654-4b76-bee6-448f375a434a-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-f24a8bc2-1654-4b76-bee6-448f375a434a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "cinder-quobyte-f24a8bc2-1654-4b76-bee6-448f375a434a" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-f24a8bc2-1654-4b76-bee6-448f375a434a" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1abee5-7bdf-4590-8ce6-a97b7a2e884b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:06 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a Jul 09 15:22:06 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:06 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60" returned: 0 in 0.885s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] <== create_volume: return (2350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.354s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1377606175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a10687-baf8-449c-973f-b4cf7e1af8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a3c232b39b49bf981e077d0239cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:05Z,use_quota=True,user_id='547991ec7a1043218a763d7262037672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Creating volume 36a10687-baf8-449c-973f-b4cf7e1af8d9 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:06 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:06 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 1073741824 Jul 09 15:22:06 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7aee67b-869c-4b13-a897-2f702eaa669a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b562a6f-4213-4783-841e-9a38bc25bd60', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a5a36f-8c80-4bf0-94c3-46b993899a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:06 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Volume volume-5b562a6f-4213-4783-841e-9a38bc25bd60 (5b562a6f-4213-4783-841e-9a38bc25bd60): created successfully Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a5a36f-8c80-4bf0-94c3-46b993899a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Flow 'volume_create_manager' (6c4498df-4672-4bce-9ecf-419d3f5024e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:06 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b1a27212-7b44-49f6-9021-4485c900800b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Created volume successfully. Jul 09 15:22:07 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a" returned: 0 in 1.085s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:07 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a Jul 09 15:22:07 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:07 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 1073741824" returned: 0 in 1.152s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:07 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 Jul 09 15:22:07 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:08 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f24a8bc2-1654-4b76-bee6-448f375a434a" returned: 0 in 0.984s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-quobyte-f24a8bc2-1654-4b76-bee6-448f375a434a" released by "delete_volume" :: held 2.186s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Created reservations ['eb1998c4-a1ec-461c-9b63-f90adf38dac7', '6a434f31-5b40-4eac-af5b-23ef86fedee8', 'df1281d3-cebc-4e90-9c85-b695c91a22e0', '031936b0-a284-482b-bb21-8bd97a915280'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:08 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9" returned: 0 in 0.868s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:08 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:22:08 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37d94e3-8bc3-461e-b379-599e4cd822a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a10687-baf8-449c-973f-b4cf7e1af8d9', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec6fcb0-08e1-4e6c-9ff6-df797b7a5d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:08 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Volume volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 (36a10687-baf8-449c-973f-b4cf7e1af8d9): created successfully Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec6fcb0-08e1-4e6c-9ff6-df797b7a5d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Flow 'volume_create_manager' (e5daea62-0577-4dde-8e54-4f708cbf5fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:08 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7631bd36-536b-44f0-934e-f43cfd203b22 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Created volume successfully. Jul 09 15:22:09 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.866s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:09 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Deleted volume successfully. Jul 09 15:22:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fc1ce59c-2e36-453d-a44a-e069c4ed1741 tempest-VolumesSnapshotTestJSON-1505281318 None] Lock "cinder-f24a8bc2-1654-4b76-bee6-448f375a434a-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (aaf2958e-14a8-49e0-80ef-49cc88606dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca4a202-ae36-43aa-a374-0c770ac75a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca4a202-ae36-43aa-a374-0c770ac75a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462729782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec9d683-fd2c-4984-bbcb-87f8827a4560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:12Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1722c02-1fba-49d8-be1e-09f63ab22e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1722c02-1fba-49d8-be1e-09f63ab22e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af911aa-f568-4352-a7b8-d8bdcc6e424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af911aa-f568-4352-a7b8-d8bdcc6e424c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cec9d683-fd2c-4984-bbcb-87f8827a4560', 'volume_name': 'volume-cec9d683-fd2c-4984-bbcb-87f8827a4560', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692cee70-4f5d-47b0-9064-370f21529df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692cee70-4f5d-47b0-9064-370f21529df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8559994b-0dda-4e8e-9f48-06215d4504ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:12 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume cec9d683-fd2c-4984-bbcb-87f8827a4560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cec9d683-fd2c-4984-bbcb-87f8827a4560', 'volume_size': 1} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462729782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec9d683-fd2c-4984-bbcb-87f8827a4560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:12Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Creating volume cec9d683-fd2c-4984-bbcb-87f8827a4560 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:12 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:12 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 1073741824 Jul 09 15:22:12 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:13 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 1073741824" returned: 0 in 1.069s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:13 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 Jul 09 15:22:13 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:14 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560" returned: 0 in 0.788s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8559994b-0dda-4e8e-9f48-06215d4504ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec9d683-fd2c-4984-bbcb-87f8827a4560', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa495237-19de-4d80-a1f5-f4bbd2a51063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:14 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 (cec9d683-fd2c-4984-bbcb-87f8827a4560): created successfully Jul 09 15:22:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa495237-19de-4d80-a1f5-f4bbd2a51063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (aaf2958e-14a8-49e0-80ef-49cc88606dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-16143aba-c477-47bc-88d2-7c593da7b6fd tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created volume successfully. Jul 09 15:22:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Creating offline snapshot 72a4071e-4654-4219-8a5a-842281aad29b of volume cec9d683-fd2c-4984-bbcb-87f8827a4560 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:22:15 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c8d167-c521-4fdb-add1-092bf67a7945]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:15 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 Jul 09 15:22:15 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:16 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560" returned: 0 in 1.004s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:16 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b 1G Jul 09 15:22:16 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Flow 'volume_create_manager' (cf2fe97e-94e9-481b-a902-3abb07fb9ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bb3708-c799-45d0-ba8c-2b71d05601f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bb3708-c799-45d0-ba8c-2b71d05601f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1288240060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6daa104-b2e4-4139-81cb-7d4677f0c4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f6627fadab46909c7885c5a248eb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:17Z,use_quota=True,user_id='005a8f1a6e5d4c78b4d43a1da56e1aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e377a170-b2c8-4133-a7b8-b387400a7fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e377a170-b2c8-4133-a7b8-b387400a7fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdc4426-06d8-46f4-8ed6-b6d90542c291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdc4426-06d8-46f4-8ed6-b6d90542c291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6daa104-b2e4-4139-81cb-7d4677f0c4f3', 'volume_name': 'volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b587fa7-dc57-4a46-bd6c-6ab8a078390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b587fa7-dc57-4a46-bd6c-6ab8a078390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb297d1c-a17d-4525-9e15-82ab73f15a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:16 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Volume d6daa104-b2e4-4139-81cb-7d4677f0c4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3', 'volume_size': 1} Jul 09 15:22:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:17 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b 1G" returned: 0 in 0.817s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:17 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b Jul 09 15:22:17 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:18 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b" returned: 0 in 0.718s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:18 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b is being set with open permissions: ugo+rw Jul 09 15:22:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:18 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b Jul 09 15:22:18 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:18 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b" returned: 0 in 0.654s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:18 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.info Jul 09 15:22:18 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:19 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.info" returned: 0 in 0.771s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:19 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.info is being set with open permissions: ugo+rw Jul 09 15:22:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:19 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.info Jul 09 15:22:19 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:20 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.info" returned: 0 in 0.726s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.790s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.586s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1288240060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6daa104-b2e4-4139-81cb-7d4677f0c4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f6627fadab46909c7885c5a248eb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:17Z,use_quota=True,user_id='005a8f1a6e5d4c78b4d43a1da56e1aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Creating volume d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:20 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:20 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 1073741824 Jul 09 15:22:20 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:20 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3f2be7b0-dcb4-4eb3-9f98-31a6b9a8c123 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Create snapshot completed successfully Jul 09 15:22:21 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 1073741824" returned: 0 in 1.006s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (c405c52f-1ffe-49b2-b997-49e9ac407295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db84b7a-2e6a-43de-9b7e-93b8a22ec604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db84b7a-2e6a-43de-9b7e-93b8a22ec604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1255457227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a7e610-f800-491b-b69c-c410cae4f6d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:21Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4328b3a-f10a-4e45-b5cd-fe1a636a516d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4328b3a-f10a-4e45-b5cd-fe1a636a516d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ff2dda-f0c4-433f-a25f-12e5b7892106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ff2dda-f0c4-433f-a25f-12e5b7892106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a7e610-f800-491b-b69c-c410cae4f6d7', 'volume_name': 'volume-b7a7e610-f800-491b-b69c-c410cae4f6d7', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10a039a-a245-47a0-8d8b-c064d80705af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10a039a-a245-47a0-8d8b-c064d80705af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d926a8-e042-4f1d-a857-39102903c0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume b7a7e610-f800-491b-b69c-c410cae4f6d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a7e610-f800-491b-b69c-c410cae4f6d7', 'volume_size': 1} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:21 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 Jul 09 15:22:21 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (a03f9cc9-e506-4821-947e-094a6a9663d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cca3aed-5080-49ea-9887-7e81fd6dc984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cca3aed-5080-49ea-9887-7e81fd6dc984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1397988488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580b413e-16e0-4430-b587-aaefbfe37a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:22Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a715cf8-a9ae-4270-b1fe-254ff54f651e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a715cf8-a9ae-4270-b1fe-254ff54f651e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cf081b-ff14-4aae-9f7a-a85b53b501ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cf081b-ff14-4aae-9f7a-a85b53b501ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '580b413e-16e0-4430-b587-aaefbfe37a6e', 'volume_name': 'volume-580b413e-16e0-4430-b587-aaefbfe37a6e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea9b148-443d-4182-aa9d-46547c6c05a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea9b148-443d-4182-aa9d-46547c6c05a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f617d74-09d2-4ba2-ac5c-e443cc424713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume 580b413e-16e0-4430-b587-aaefbfe37a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-580b413e-16e0-4430-b587-aaefbfe37a6e', 'volume_size': 1} Jul 09 15:22:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (b401bbc1-6a7e-4ffe-8413-3c0a18677fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66acf1b9-2de8-4afe-9d78-fda02c498014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66acf1b9-2de8-4afe-9d78-fda02c498014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962287021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87adadba-5ce0-4a07-a620-caf23ad3ffee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:22Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b2db83-b2ea-4023-a83c-940582244bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b2db83-b2ea-4023-a83c-940582244bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0bcf48-d028-4395-8e38-2155396b95d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0bcf48-d028-4395-8e38-2155396b95d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87adadba-5ce0-4a07-a620-caf23ad3ffee', 'volume_name': 'volume-87adadba-5ce0-4a07-a620-caf23ad3ffee', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830d7c89-6674-43e3-98fd-c3ec11f96e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830d7c89-6674-43e3-98fd-c3ec11f96e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0cb7ed-8e11-47a8-ac18-8ef20ca5cb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume 87adadba-5ce0-4a07-a620-caf23ad3ffee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87adadba-5ce0-4a07-a620-caf23ad3ffee', 'volume_size': 1} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" returned: 0 in 0.916s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1255457227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a7e610-f800-491b-b69c-c410cae4f6d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:21Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Creating volume b7a7e610-f800-491b-b69c-c410cae4f6d7 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:22 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb297d1c-a17d-4525-9e15-82ab73f15a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa617b8-f984-4f46-8540-f2ac17f1dd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7 1073741824 Jul 09 15:22:22 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Volume volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 (d6daa104-b2e4-4139-81cb-7d4677f0c4f3): created successfully Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa617b8-f984-4f46-8540-f2ac17f1dd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Flow 'volume_create_manager' (cf2fe97e-94e9-481b-a902-3abb07fb9ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e4ad7c2b-0c96-4f70-9ecd-250234a41724 tempest-VolumesSnapshotListTestJSON-393538521 None] Created volume successfully. Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (00ee3d82-b2e7-4b1c-b813-836ebd90158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7adf8e-7f0e-45c8-9075-32886f3fd193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7adf8e-7f0e-45c8-9075-32886f3fd193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1673938153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ecfc21-2b34-494e-806f-09fe0720e64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:23Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3814c2-0eab-4311-a022-49f90f1628fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3814c2-0eab-4311-a022-49f90f1628fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d5f80b-7a94-4e75-877c-eb954a6b3334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d5f80b-7a94-4e75-877c-eb954a6b3334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ecfc21-2b34-494e-806f-09fe0720e64b', 'volume_name': 'volume-f6ecfc21-2b34-494e-806f-09fe0720e64b', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8496096-f900-4994-a18e-4e84c5d3dc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8496096-f900-4994-a18e-4e84c5d3dc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99dfcdc3-6784-425e-aebf-2ca7c0ad4ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume f6ecfc21-2b34-494e-806f-09fe0720e64b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ecfc21-2b34-494e-806f-09fe0720e64b', 'volume_size': 1} Jul 09 15:22:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (f7b51f52-6d54-4554-930b-0adf32b49d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d462113-9c42-4bc6-bb3b-5e30b3dc51fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d462113-9c42-4bc6-bb3b-5e30b3dc51fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038759767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf724b80-9764-427d-8723-60b4bdddabed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:23Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02be20b3-0c86-4ba2-93fc-a77b1b2509b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02be20b3-0c86-4ba2-93fc-a77b1b2509b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28aa05bd-f7c5-482c-8dff-a82224ad881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28aa05bd-f7c5-482c-8dff-a82224ad881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf724b80-9764-427d-8723-60b4bdddabed', 'volume_name': 'volume-bf724b80-9764-427d-8723-60b4bdddabed', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc0188d-5293-421a-983c-c19846231e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc0188d-5293-421a-983c-c19846231e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ef83e8-e7b2-497a-a99f-89728abf52c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume bf724b80-9764-427d-8723-60b4bdddabed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf724b80-9764-427d-8723-60b4bdddabed', 'volume_size': 1} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:23 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7 1073741824" returned: 0 in 1.323s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:23 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7 Jul 09 15:22:23 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:24 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7" returned: 0 in 0.717s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.603s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1397988488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580b413e-16e0-4430-b587-aaefbfe37a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:22Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Creating volume 580b413e-16e0-4430-b587-aaefbfe37a6e {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:24 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:24 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e 1073741824 Jul 09 15:22:24 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d926a8-e042-4f1d-a857-39102903c0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a7e610-f800-491b-b69c-c410cae4f6d7', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4163ef75-181e-49f9-84fc-98fa53675e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:24 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume volume-b7a7e610-f800-491b-b69c-c410cae4f6d7 (b7a7e610-f800-491b-b69c-c410cae4f6d7): created successfully Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4163ef75-181e-49f9-84fc-98fa53675e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (c405c52f-1ffe-49b2-b997-49e9ac407295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:24 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3f5340d9-b3a3-40f7-a1d5-25b19df28687 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created volume successfully. Jul 09 15:22:25 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e 1073741824" returned: 0 in 0.983s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:25 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e Jul 09 15:22:25 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:26 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e" returned: 0 in 0.673s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.835s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962287021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87adadba-5ce0-4a07-a620-caf23ad3ffee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:22Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Creating volume 87adadba-5ce0-4a07-a620-caf23ad3ffee {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:26 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f617d74-09d2-4ba2-ac5c-e443cc424713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580b413e-16e0-4430-b587-aaefbfe37a6e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:26 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee 1073741824 Jul 09 15:22:26 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4b50cf-fb2a-4a35-8c77-cfcbb25c13a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:26 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume volume-580b413e-16e0-4430-b587-aaefbfe37a6e (580b413e-16e0-4430-b587-aaefbfe37a6e): created successfully Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4b50cf-fb2a-4a35-8c77-cfcbb25c13a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (a03f9cc9-e506-4821-947e-094a6a9663d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b20def4a-4ea7-47fd-b476-c169e1afb1f4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created volume successfully. Jul 09 15:22:27 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee 1073741824" returned: 0 in 0.864s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:27 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee Jul 09 15:22:27 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:27 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee" returned: 0 in 0.671s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.914s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1673938153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ecfc21-2b34-494e-806f-09fe0720e64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:23Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Creating volume f6ecfc21-2b34-494e-806f-09fe0720e64b {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:27 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:27 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b 1073741824 Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0cb7ed-8e11-47a8-ac18-8ef20ca5cb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87adadba-5ce0-4a07-a620-caf23ad3ffee', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:27 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0386f7-1930-4141-9d3b-aae6a2688dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:27 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume volume-87adadba-5ce0-4a07-a620-caf23ad3ffee (87adadba-5ce0-4a07-a620-caf23ad3ffee): created successfully Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0386f7-1930-4141-9d3b-aae6a2688dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (b401bbc1-6a7e-4ffe-8413-3c0a18677fd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:27 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e29732e4-bd53-4364-b969-6a9b99a81e32 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created volume successfully. Jul 09 15:22:28 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b 1073741824" returned: 0 in 0.825s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:28 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b Jul 09 15:22:28 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:29 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b" returned: 0 in 0.668s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.745s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038759767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf724b80-9764-427d-8723-60b4bdddabed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8d9625e2a245759aa81b3e56ebebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:23Z,use_quota=True,user_id='139378fda12f4caba1bc4e09c271169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Creating volume bf724b80-9764-427d-8723-60b4bdddabed {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:29 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99dfcdc3-6784-425e-aebf-2ca7c0ad4ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ecfc21-2b34-494e-806f-09fe0720e64b', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:29 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed 1073741824 Jul 09 15:22:29 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f432051-2d34-475c-a456-4450625fd15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:29 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume volume-f6ecfc21-2b34-494e-806f-09fe0720e64b (f6ecfc21-2b34-494e-806f-09fe0720e64b): created successfully Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f432051-2d34-475c-a456-4450625fd15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (00ee3d82-b2e7-4b1c-b813-836ebd90158d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:29 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-25cd9c22-a0a6-4a32-898e-a21cd30bf678 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created volume successfully. Jul 09 15:22:30 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed 1073741824" returned: 0 in 0.858s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:30 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed Jul 09 15:22:30 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:30 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed" returned: 0 in 0.675s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.321s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ef83e8-e7b2-497a-a99f-89728abf52c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf724b80-9764-427d-8723-60b4bdddabed', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a09e3e6-a227-4048-adb2-8620611f0383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Creating offline snapshot b5faee76-4d44-4af6-83f5-109fcce48d23 of volume d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:22:31 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Volume volume-bf724b80-9764-427d-8723-60b4bdddabed (bf724b80-9764-427d-8723-60b4bdddabed): created successfully Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a09e3e6-a227-4048-adb2-8620611f0383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Flow 'volume_create_manager' (f7b51f52-6d54-4554-930b-0adf32b49d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ef11b7-930f-4331-b4f2-dd35ca0a07db]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:31 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-52750cc1-ac6c-4ca0-b1c7-50fbd4b96f1c tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created volume successfully. Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-bf724b80-9764-427d-8723-60b4bdddabed-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:31 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 Jul 09 15:22:31 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-bf724b80-9764-427d-8723-60b4bdddabed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-quobyte-bf724b80-9764-427d-8723-60b4bdddabed" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-bf724b80-9764-427d-8723-60b4bdddabed" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[398bf7c4-f157-4d9e-a265-4fbdb054ac5a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:31 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed Jul 09 15:22:31 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:31 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" returned: 0 in 0.854s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:31 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 1G Jul 09 15:22:31 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:32 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed" returned: 0 in 0.810s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:32 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed Jul 09 15:22:32 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:32 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 1G" returned: 0 in 0.841s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:32 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 Jul 09 15:22:32 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:32 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-bf724b80-9764-427d-8723-60b4bdddabed" returned: 0 in 0.679s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-bf724b80-9764-427d-8723-60b4bdddabed" released by "delete_volume" :: held 1.540s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created reservations ['dea4fe52-9a9b-4974-a093-c02ded948b03', '5b5b4936-adcf-4c74-be93-f5a2b0145ea3', 'd6b1393a-5b0d-46fe-9c65-241ae2ec2615', '36bc3d69-66ff-4404-a12f-2b95b16484f2'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:33 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:22:33 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:33 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23" returned: 0 in 0.741s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:33 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 is being set with open permissions: ugo+rw Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:33 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 Jul 09 15:22:33 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-f6ecfc21-2b34-494e-806f-09fe0720e64b-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-f6ecfc21-2b34-494e-806f-09fe0720e64b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-quobyte-f6ecfc21-2b34-494e-806f-09fe0720e64b" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-f6ecfc21-2b34-494e-806f-09fe0720e64b" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:33 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.742s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:33 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Deleted volume successfully. Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7a07c4-ba07-4c32-80de-a95faec2702e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d82b6ae3-8709-4683-9acb-f21dad18ef2d tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-bf724b80-9764-427d-8723-60b4bdddabed-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:33 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b Jul 09 15:22:33 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:34 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23" returned: 0 in 0.754s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:34 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.info Jul 09 15:22:34 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:34 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b" returned: 0 in 0.870s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:34 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b Jul 09 15:22:34 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:35 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.info" returned: 0 in 0.713s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:35 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.info is being set with open permissions: ugo+rw Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:35 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.info Jul 09 15:22:35 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:35 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f6ecfc21-2b34-494e-806f-09fe0720e64b" returned: 0 in 0.671s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-f6ecfc21-2b34-494e-806f-09fe0720e64b" released by "delete_volume" :: held 1.596s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created reservations ['31dd4ca0-39fe-4882-a37a-f050df74f87f', '851c220e-6d3b-4d42-9851-fef9c8836280', '72c9bac4-c5dd-4a9a-8d2f-850d5d4330b0', 'fc2a51ec-c71b-4372-94e6-dffdd9e7db89'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:35 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:22:35 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:35 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.info" returned: 0 in 0.652s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.691s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7c4a6469-70ad-44e4-9f29-5e3f6c86b78a tempest-VolumesSnapshotListTestJSON-393538521 None] Create snapshot completed successfully Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-87adadba-5ce0-4a07-a620-caf23ad3ffee-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-87adadba-5ce0-4a07-a620-caf23ad3ffee-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-quobyte-87adadba-5ce0-4a07-a620-caf23ad3ffee" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-87adadba-5ce0-4a07-a620-caf23ad3ffee" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d6e4f4-2207-4d18-a447-7ba2810ca706]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:36 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee Jul 09 15:22:36 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:36 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.709s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:36 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:36 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Deleted volume successfully. Jul 09 15:22:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dfd7fc17-61df-4283-b4bc-933186465534 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-f6ecfc21-2b34-494e-806f-09fe0720e64b-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] Creating offline snapshot e6843fff-3f7c-40d7-a740-487c1db65dbb of volume d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:22:36 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a1a34e-132b-4624-9448-1b2bb4820a15]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:36 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 Jul 09 15:22:36 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:36 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee" returned: 0 in 0.781s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:36 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee Jul 09 15:22:36 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:37 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23" returned: 0 in 0.786s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:37 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb 1G Jul 09 15:22:37 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:37 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-87adadba-5ce0-4a07-a620-caf23ad3ffee" returned: 0 in 0.659s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-87adadba-5ce0-4a07-a620-caf23ad3ffee" released by "delete_volume" :: held 1.479s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created reservations ['c9ea2fe1-b260-4225-8b56-f22159011be8', '82968f18-1ac8-47ca-a8ef-5a3a7814a1a0', 'da89c521-4443-492c-ab29-2283567e8187', '29a2abc7-b8ee-468d-a638-4420bbc48b0b'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:37 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:22:37 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:37 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb 1G" returned: 0 in 0.840s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:37 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb Jul 09 15:22:37 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-580b413e-16e0-4430-b587-aaefbfe37a6e-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-580b413e-16e0-4430-b587-aaefbfe37a6e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-quobyte-580b413e-16e0-4430-b587-aaefbfe37a6e" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-580b413e-16e0-4430-b587-aaefbfe37a6e" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[41defd96-2538-414b-8fae-d53407b351fc]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:38 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.761s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:38 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Deleted volume successfully. Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-00d58ad0-f3d7-4ec4-b9c4-73d60dd823b1 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-87adadba-5ce0-4a07-a620-caf23ad3ffee-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:38 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e Jul 09 15:22:38 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:38 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb" returned: 0 in 0.706s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:38 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb is being set with open permissions: ugo+rw Jul 09 15:22:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:38 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb Jul 09 15:22:38 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:39 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e" returned: 0 in 0.800s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:39 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e Jul 09 15:22:39 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:39 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb" returned: 0 in 0.642s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.077s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:39 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-23ca3675-de3a-44cc-aca9-5466a6f7f5ea tempest-VolumesSnapshotListTestJSON-393538521 None] Create snapshot completed successfully Jul 09 15:22:39 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-580b413e-16e0-4430-b587-aaefbfe37a6e" returned: 0 in 0.668s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-580b413e-16e0-4430-b587-aaefbfe37a6e" released by "delete_volume" :: held 1.510s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created reservations ['9464f7ea-0b96-48b7-9cc7-5e08abfc35b8', 'ea326696-1633-4e7c-939d-a80f28efb4a6', '2ea2f109-3761-4fd9-99f5-82b2beca5f52', '912b4fa3-2473-4c0f-ae29-677c65999890'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:39 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:22:39 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-b7a7e610-f800-491b-b69c-c410cae4f6d7-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-b7a7e610-f800-491b-b69c-c410cae4f6d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-quobyte-b7a7e610-f800-491b-b69c-c410cae4f6d7" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-b7a7e610-f800-491b-b69c-c410cae4f6d7" acquired by "delete_volume" :: waited 0.040s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d6c2ac-2d27-4e6c-b5fb-e2620e81e743]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:40 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.714s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:40 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Deleted volume successfully. Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-97de18e8-314f-4fe3-a41e-467708ee7b0b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-580b413e-16e0-4430-b587-aaefbfe37a6e-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:40 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7 Jul 09 15:22:40 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] Creating offline snapshot 15409747-707f-4138-a6e1-6d2885efb8b8 of volume d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7e0d5b-a0b1-4026-8df2-3e93b77f6c79]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:40 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb Jul 09 15:22:40 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:41 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7" returned: 0 in 0.800s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:41 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7 Jul 09 15:22:41 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:41 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb" returned: 0 in 0.882s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:22:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:41 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 1G Jul 09 15:22:41 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:41 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b7a7e610-f800-491b-b69c-c410cae4f6d7" returned: 0 in 0.693s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-b7a7e610-f800-491b-b69c-c410cae4f6d7" released by "delete_volume" :: held 1.553s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created reservations ['b6f4598a-3d4d-4f5b-9953-126a61cf00ad', 'f83bfc8a-a196-4bf0-9da4-0ec4f0b6a2a8', 'df4cf57e-21e2-422a-ac56-ab7e8dc87a5c', 'df880a47-d167-4549-bc72-4d78e2aeb586'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:42 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:22:42 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:42 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 1G" returned: 0 in 0.875s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:42 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 Jul 09 15:22:42 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-72a4071e-4654-4219-8a5a-842281aad29b-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-72a4071e-4654-4219-8a5a-842281aad29b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-quobyte-cec9d683-fd2c-4984-bbcb-87f8827a4560" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-cec9d683-fd2c-4984-bbcb-87f8827a4560" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-quobyte-72a4071e-4654-4219-8a5a-842281aad29b" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-72a4071e-4654-4219-8a5a-842281aad29b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Deleting offline snapshot 72a4071e-4654-4219-8a5a-842281aad29b of volume cec9d683-fd2c-4984-bbcb-87f8827a4560 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] snapshot_file for this snap is: volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[9071117e-e534-467b-87e4-5eed0b6197f6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:42 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.670s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:42 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Deleted volume successfully. Jul 09 15:22:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-396a16bd-2325-438b-bcf9-2be74d5b9f4b tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-b7a7e610-f800-491b-b69c-c410cae4f6d7-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:42 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b Jul 09 15:22:42 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:43 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8" returned: 0 in 0.720s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:43 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 is being set with open permissions: ugo+rw Jul 09 15:22:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:43 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 Jul 09 15:22:43 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:43 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b" returned: 0 in 0.820s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cec9d683-fd2c-4984-bbcb-87f8827a4560(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:22:43 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf5067f-20ae-4718-b1f0-e26ba3b73b55]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:43 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 Jul 09 15:22:43 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:43 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8" returned: 0 in 0.685s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.272s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:44 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3e487a1e-163e-4885-930d-00ad57b3452b tempest-VolumesSnapshotListTestJSON-393538521 None] Create snapshot completed successfully Jul 09 15:22:44 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560" returned: 0 in 0.757s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:44 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b Jul 09 15:22:44 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:45 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b" returned: 0 in 0.791s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:45 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b Jul 09 15:22:45 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:45 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560.72a4071e-4654-4219-8a5a-842281aad29b" returned: 0 in 0.698s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-72a4071e-4654-4219-8a5a-842281aad29b" released by "_delete_snapshot" :: held 3.182s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-cec9d683-fd2c-4984-bbcb-87f8827a4560" released by "delete_snapshot" :: held 3.218s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-15409747-707f-4138-a6e1-6d2885efb8b8-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created reservations ['827bca6e-1446-44a0-a82c-1e5965a13a4a', '7d98a415-530d-42f7-8525-13672d9d1924', '3d22da83-c1fc-4b2d-be33-3be89968c718', '581c458e-c6b7-4a2e-8159-ad65c4e9bf7f'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-15409747-707f-4138-a6e1-6d2885efb8b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-quobyte-15409747-707f-4138-a6e1-6d2885efb8b8" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-15409747-707f-4138-a6e1-6d2885efb8b8" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Deleting offline snapshot 15409747-707f-4138-a6e1-6d2885efb8b8 of volume d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] snapshot_file for this snap is: volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b61f10-132d-486d-beff-28819b597771]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:46 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Delete snapshot completed successfully. Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3c8a222e-9b78-4775-a563-f773adc45222 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-72a4071e-4654-4219-8a5a-842281aad29b-delete_snapshot" released by "delete_snapshot" :: held 3.454s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:46 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 Jul 09 15:22:46 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:46 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8" returned: 0 in 0.771s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-cec9d683-fd2c-4984-bbcb-87f8827a4560-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1222c160-9e05-413d-bd34-ac4e7916cb16]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-cec9d683-fd2c-4984-bbcb-87f8827a4560-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "cinder-quobyte-cec9d683-fd2c-4984-bbcb-87f8827a4560" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-cec9d683-fd2c-4984-bbcb-87f8827a4560" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ae951-4c20-403e-a51f-4cddc1057525]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:46 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb Jul 09 15:22:46 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:47 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 Jul 09 15:22:47 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:47 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb" returned: 0 in 0.775s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:22:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:47 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 Jul 09 15:22:47 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:47 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560" returned: 0 in 0.747s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:47 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560 Jul 09 15:22:47 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:48 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cec9d683-fd2c-4984-bbcb-87f8827a4560" returned: 0 in 0.677s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-quobyte-cec9d683-fd2c-4984-bbcb-87f8827a4560" released by "delete_volume" :: held 1.492s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Created reservations ['5d98fc1e-e15b-4463-96b3-0723a31ee968', '3b5f4e2b-b924-439d-a17b-6ac7d3f255a6', 'aadc3b7a-0595-4c75-8d07-8aca45f604e8', 'bab4349c-21ec-4f6f-a8eb-fe1637b79159'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:48 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8" returned: 0 in 0.858s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:48 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8 Jul 09 15:22:48 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:48 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:22:48 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-c5a39761-37c7-41fb-aafa-10df0fd8b9f1 req-2ff5ee84-f761-4c17-8aed-da28b6e3859b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-c5a39761-37c7-41fb-aafa-10df0fd8b9f1 req-2ff5ee84-f761-4c17-8aed-da28b6e3859b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dd3a90-56f4-46cc-ae74-c2c754f5c705]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-c5a39761-37c7-41fb-aafa-10df0fd8b9f1 req-2ff5ee84-f761-4c17-8aed-da28b6e3859b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:49 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 Jul 09 15:22:49 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:49 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.15409747-707f-4138-a6e1-6d2885efb8b8" returned: 0 in 0.697s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-15409747-707f-4138-a6e1-6d2885efb8b8" released by "_delete_snapshot" :: held 3.248s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" released by "delete_snapshot" :: held 3.286s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:49 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.753s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:49 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Deleted volume successfully. Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Created reservations ['6b6791ab-6f80-4cc7-ab8d-cc7a65b21eaf', '76ab8d31-db81-43e2-8865-288632e042e3', 'bb602ebc-0bff-468d-b862-7c3fb00a090f', '423fddfc-e41e-4261-92c0-7476b2ab77f0'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9bf3b192-a21e-4353-abc3-59c8023a0ac4 tempest-CreateVolumesFromSnapshotTest-1600304719 None] Lock "cinder-cec9d683-fd2c-4984-bbcb-87f8827a4560-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:49 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Delete snapshot completed successfully. Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3dfb246-e88f-4dc3-a0be-79093711506e tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-15409747-707f-4138-a6e1-6d2885efb8b8-delete_snapshot" released by "delete_snapshot" :: held 3.508s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:49 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-c5a39761-37c7-41fb-aafa-10df0fd8b9f1 req-2ff5ee84-f761-4c17-8aed-da28b6e3859b tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60" returned: 0 in 0.872s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-c5a39761-37c7-41fb-aafa-10df0fd8b9f1 req-2ff5ee84-f761-4c17-8aed-da28b6e3859b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.901s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-c5a39761-37c7-41fb-aafa-10df0fd8b9f1 req-2ff5ee84-f761-4c17-8aed-da28b6e3859b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-5b562a6f-4213-4783-841e-9a38bc25bd60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f4c339a-913e-4f79-afd8-342319ef330c', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:22:50 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-c5a39761-37c7-41fb-aafa-10df0fd8b9f1 req-2ff5ee84-f761-4c17-8aed-da28b6e3859b tempest-TestServerVolumeAttachmentScenario-1340707866 None] attachment_update completed successfully. Jul 09 15:22:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-e6843fff-3f7c-40d7-a740-487c1db65dbb-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-e6843fff-3f7c-40d7-a740-487c1db65dbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-quobyte-e6843fff-3f7c-40d7-a740-487c1db65dbb" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-e6843fff-3f7c-40d7-a740-487c1db65dbb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Deleting offline snapshot e6843fff-3f7c-40d7-a740-487c1db65dbb of volume d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:22:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] snapshot_file for this snap is: volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:22:50 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[38845bb6-79a4-4dbd-a66e-9a48aadfb313]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:50 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb Jul 09 15:22:50 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:51 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb" returned: 0 in 0.871s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:22:51 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[dece1d13-332d-4e1e-b015-f5372532834a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:51 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 Jul 09 15:22:51 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:51 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23" returned: 0 in 0.810s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:22:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:51 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb Jul 09 15:22:51 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (b24eba7c-57ed-4227-bb69-a4abdc881a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7548b1-c7cd-4083-90b9-3c41b8f70a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7548b1-c7cd-4083-90b9-3c41b8f70a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-768456817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243d4de0-2c35-49c4-845e-091b3a2c21af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:52Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3a8707-b01d-4471-a14b-a1f90c367919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3a8707-b01d-4471-a14b-a1f90c367919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f7d4a5-27d3-442e-aa9a-fdba487d720d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f7d4a5-27d3-442e-aa9a-fdba487d720d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243d4de0-2c35-49c4-845e-091b3a2c21af', 'volume_name': 'volume-243d4de0-2c35-49c4-845e-091b3a2c21af', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe94cb8a-4055-4e39-85d8-41362a4f8936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe94cb8a-4055-4e39-85d8-41362a4f8936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f14a95a-640d-4bb9-b304-3eedd3f54bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:52 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume 243d4de0-2c35-49c4-845e-091b3a2c21af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243d4de0-2c35-49c4-845e-091b3a2c21af', 'volume_size': 1} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-768456817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243d4de0-2c35-49c4-845e-091b3a2c21af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:52Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Creating volume 243d4de0-2c35-49c4-845e-091b3a2c21af {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:52 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:52 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af 1073741824 Jul 09 15:22:52 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:52 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb" returned: 0 in 0.794s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:52 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb Jul 09 15:22:52 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:53 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af 1073741824" returned: 0 in 0.834s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:53 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af Jul 09 15:22:53 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:53 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.e6843fff-3f7c-40d7-a740-487c1db65dbb" returned: 0 in 0.694s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-e6843fff-3f7c-40d7-a740-487c1db65dbb" released by "_delete_snapshot" :: held 3.262s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" released by "delete_snapshot" :: held 3.284s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Created reservations ['5b0df020-c433-4548-990d-9cf6ca0882bd', '298f28b2-6e2e-4b7a-82fa-3de7cc7d1509', '57bb5dea-507f-457c-88c9-b7e4486ff516', '3c18190b-169c-4add-85c7-a67fcbbd1d05'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:53 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Delete snapshot completed successfully. Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-693da14b-18c6-4c84-ba5d-4d34da0d0edc tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-e6843fff-3f7c-40d7-a740-487c1db65dbb-delete_snapshot" released by "delete_snapshot" :: held 3.431s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:53 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af" returned: 0 in 0.674s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f14a95a-640d-4bb9-b304-3eedd3f54bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243d4de0-2c35-49c4-845e-091b3a2c21af', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e9e2e7-a495-4a68-ad5a-2257a99639e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:53 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume volume-243d4de0-2c35-49c4-845e-091b3a2c21af (243d4de0-2c35-49c4-845e-091b3a2c21af): created successfully Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e9e2e7-a495-4a68-ad5a-2257a99639e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (b24eba7c-57ed-4227-bb69-a4abdc881a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:54 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-df07bc64-0575-4318-b60c-332095dda5ca tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created volume successfully. Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-b5faee76-4d44-4af6-83f5-109fcce48d23-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-b5faee76-4d44-4af6-83f5-109fcce48d23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-quobyte-b5faee76-4d44-4af6-83f5-109fcce48d23" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-b5faee76-4d44-4af6-83f5-109fcce48d23" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Deleting offline snapshot b5faee76-4d44-4af6-83f5-109fcce48d23 of volume d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] snapshot_file for this snap is: volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8927a27e-da02-4297-8317-9e664c105d54]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:54 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 Jul 09 15:22:54 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (037a17fc-2e86-4956-84c0-4fbf69be3b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51910d3-129e-4e6b-8824-275d128d04a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51910d3-129e-4e6b-8824-275d128d04a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151234090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f858bb3e-8269-4068-8d62-efcdbc6128be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:55Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2f1682-ea20-41e5-b504-52137e18abaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2f1682-ea20-41e5-b504-52137e18abaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349c4373-93a0-4c14-8e92-24a1b573597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349c4373-93a0-4c14-8e92-24a1b573597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f858bb3e-8269-4068-8d62-efcdbc6128be', 'volume_name': 'volume-f858bb3e-8269-4068-8d62-efcdbc6128be', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed10e26-e477-4fc7-b0ce-47af914b7ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed10e26-e477-4fc7-b0ce-47af914b7ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e72127-920c-4f08-9d7c-fa3e7400e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:54 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume f858bb3e-8269-4068-8d62-efcdbc6128be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f858bb3e-8269-4068-8d62-efcdbc6128be', 'volume_size': 1} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151234090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f858bb3e-8269-4068-8d62-efcdbc6128be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:55Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Creating volume f858bb3e-8269-4068-8d62-efcdbc6128be {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:54 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:54 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be 1073741824 Jul 09 15:22:54 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=133,cinder:SELECT=96,cinder:INSERT=30,cinder:DELETE=11 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=132,cinder:DELETE=13,cinder:SELECT=112,cinder:INSERT=34 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (a5eb0744-fbdf-4878-9803-a93afa7434be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65df7c01-43ee-4d9d-94d4-9724abfa1661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65df7c01-43ee-4d9d-94d4-9724abfa1661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-433714754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333bc745-6fa2-4b6e-a682-e02bf52da870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:55Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5c9ec6-1a3c-40e6-9049-a96a27e04a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5c9ec6-1a3c-40e6-9049-a96a27e04a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b8f327-4ed9-4993-8a6c-e2964e342e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b8f327-4ed9-4993-8a6c-e2964e342e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333bc745-6fa2-4b6e-a682-e02bf52da870', 'volume_name': 'volume-333bc745-6fa2-4b6e-a682-e02bf52da870', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc980825-9f8e-4aeb-9df1-e3a50ef3d2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc980825-9f8e-4aeb-9df1-e3a50ef3d2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4582ff-04a5-44d6-8f38-b6164778d9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume 333bc745-6fa2-4b6e-a682-e02bf52da870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333bc745-6fa2-4b6e-a682-e02bf52da870', 'volume_size': 1} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:55 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23" returned: 0 in 1.015s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e45fcfc-eae5-4c06-8882-158565a1e2fa]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (9d1342a5-db71-4d85-83ac-99d0b08a43d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928f88d6-375f-4442-906a-c78162df6a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:55 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 Jul 09 15:22:55 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928f88d6-375f-4442-906a-c78162df6a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-627459668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfcd730-fbe7-4a0c-8776-78a938d2d08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:56Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25184c52-a7d0-4954-9102-b7bb09554e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25184c52-a7d0-4954-9102-b7bb09554e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c044792-e5fe-4c28-9728-e592032744ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c044792-e5fe-4c28-9728-e592032744ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dfcd730-fbe7-4a0c-8776-78a938d2d08e', 'volume_name': 'volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d49fba9-06ef-4e4d-9ec6-eb19c5cf0a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d49fba9-06ef-4e4d-9ec6-eb19c5cf0a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180d04d9-dc47-4474-9e5c-b2ed14f29c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume 4dfcd730-fbe7-4a0c-8776-78a938d2d08e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e', 'volume_size': 1} Jul 09 15:22:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:56 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be 1073741824" returned: 0 in 1.227s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (b7ae541d-8f29-46c8-b9b3-8ad429e553bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aec6b9f-a9af-4a66-8034-1a03a667b402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aec6b9f-a9af-4a66-8034-1a03a667b402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-973278540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1c3c56-da27-47f1-bca7-06017678388e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:56Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4130b6e2-4b66-4eda-8791-83f58fcdfc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4130b6e2-4b66-4eda-8791-83f58fcdfc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be Jul 09 15:22:56 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580e7bf8-f9f9-4e47-b8c8-c493b0b35b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580e7bf8-f9f9-4e47-b8c8-c493b0b35b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1c3c56-da27-47f1-bca7-06017678388e', 'volume_name': 'volume-8a1c3c56-da27-47f1-bca7-06017678388e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df8ada7-4f2c-4187-98ff-d314868c5d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df8ada7-4f2c-4187-98ff-d314868c5d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5aa1a10-c0d7-460d-a8da-696c01a9877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume 8a1c3c56-da27-47f1-bca7-06017678388e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1c3c56-da27-47f1-bca7-06017678388e', 'volume_size': 1} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:56 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" returned: 0 in 1.237s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:56 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 Jul 09 15:22:56 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (87994e13-40c4-4589-883e-5e2d874ecf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00438346-6c42-46b3-a12e-3323177caa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00438346-6c42-46b3-a12e-3323177caa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2042674682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b0f5ee-a6d3-451f-adf2-c7d71fab36b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:57Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c73b25-b0f4-478d-92fc-66fa6da947f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c73b25-b0f4-478d-92fc-66fa6da947f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ed82b9-81ed-4ae7-8c1b-7fc871187201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ed82b9-81ed-4ae7-8c1b-7fc871187201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b0f5ee-a6d3-451f-adf2-c7d71fab36b0', 'volume_name': 'volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43a5983-21e3-4dd8-b8e1-a083f4c4fdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43a5983-21e3-4dd8-b8e1-a083f4c4fdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5405c2e-9d44-43b7-8543-5f5c6a223141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume 13b0f5ee-a6d3-451f-adf2-c7d71fab36b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0', 'volume_size': 1} Jul 09 15:22:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:57 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be" returned: 0 in 0.791s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-433714754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333bc745-6fa2-4b6e-a682-e02bf52da870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:55Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Creating volume 333bc745-6fa2-4b6e-a682-e02bf52da870 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:57 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e72127-920c-4f08-9d7c-fa3e7400e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f858bb3e-8269-4068-8d62-efcdbc6128be', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7163f18-56bf-4353-ae58-96230a3250ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:57 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870 1073741824 Jul 09 15:22:57 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:57 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume volume-f858bb3e-8269-4068-8d62-efcdbc6128be (f858bb3e-8269-4068-8d62-efcdbc6128be): created successfully Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7163f18-56bf-4353-ae58-96230a3250ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (037a17fc-2e86-4956-84c0-4fbf69be3b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:57 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-57ebc89a-8a5f-4693-94ba-56034851d640 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created volume successfully. Jul 09 15:22:57 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23" returned: 0 in 0.812s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:57 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23 Jul 09 15:22:57 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:58 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870 1073741824" returned: 0 in 0.972s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:58 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870 Jul 09 15:22:58 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:58 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3.b5faee76-4d44-4af6-83f5-109fcce48d23" returned: 0 in 0.730s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-b5faee76-4d44-4af6-83f5-109fcce48d23" released by "_delete_snapshot" :: held 3.916s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" released by "delete_snapshot" :: held 3.939s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Created reservations ['febef251-a863-4d02-bf8a-5f554b0d5f74', '52be2bba-fbd0-4e70-907c-396384b7d833', 'cf4c865a-5aa5-434e-b719-96456f8d44a5', '85f70bb2-492c-4ef8-bca2-d718bab4226a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:58 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Delete snapshot completed successfully. Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d571ad77-11b8-424b-8e51-8850e4ef8e89 tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-b5faee76-4d44-4af6-83f5-109fcce48d23-delete_snapshot" released by "delete_snapshot" :: held 4.073s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-d6daa104-b2e4-4139-81cb-7d4677f0c4f3-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:58 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870" returned: 0 in 0.676s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.971s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-627459668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfcd730-fbe7-4a0c-8776-78a938d2d08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:56Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Creating volume 4dfcd730-fbe7-4a0c-8776-78a938d2d08e {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:58 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-d6daa104-b2e4-4139-81cb-7d4677f0c4f3-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:58 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e 1073741824 Jul 09 15:22:58 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4582ff-04a5-44d6-8f38-b6164778d9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333bc745-6fa2-4b6e-a682-e02bf52da870', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22f5ea6-47e8-485d-b8d2-5f0386bdeeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:58 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume volume-333bc745-6fa2-4b6e-a682-e02bf52da870 (333bc745-6fa2-4b6e-a682-e02bf52da870): created successfully Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22f5ea6-47e8-485d-b8d2-5f0386bdeeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (a5eb0744-fbdf-4878-9803-a93afa7434be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:58 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-587741cc-bd29-4972-8a12-8b1b181f988d tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created volume successfully. Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5661a218-fb0d-49d8-b9e5-a8a1f3617919]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:59 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 Jul 09 15:22:59 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:59 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e 1073741824" returned: 0 in 0.842s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:59 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e Jul 09 15:22:59 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:59 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" returned: 0 in 0.803s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:59 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3 Jul 09 15:22:59 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:00 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e" returned: 0 in 0.662s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-973278540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1c3c56-da27-47f1-bca7-06017678388e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:56Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Creating volume 8a1c3c56-da27-47f1-bca7-06017678388e {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:00 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180d04d9-dc47-4474-9e5c-b2ed14f29c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89916533-360b-48f8-9931-4786a02f7b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:00 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e 1073741824 Jul 09 15:23:00 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:00 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e (4dfcd730-fbe7-4a0c-8776-78a938d2d08e): created successfully Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89916533-360b-48f8-9931-4786a02f7b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (9d1342a5-db71-4d85-83ac-99d0b08a43d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:00 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-696be9e3-b2a2-46e9-9747-e72282342993 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created volume successfully. Jul 09 15:23:00 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" returned: 0 in 0.723s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-quobyte-d6daa104-b2e4-4139-81cb-7d4677f0c4f3" released by "delete_volume" :: held 1.583s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Created reservations ['644da95b-843e-46f7-8948-bfb5c2a21bfb', '77c31553-794b-4774-b92e-ed4b8ef3b79a', '3a3f771b-c2a9-4890-ae2f-de15300f5590', 'd9d46ab0-593b-46a1-8a18-0cb1918b4d48'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:00 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:00 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:01 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.731s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:01 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:01 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e 1073741824" returned: 0 in 1.025s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:01 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Deleted volume successfully. Jul 09 15:23:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78e143d6-8bc9-4672-8928-a9d8eda7e94d tempest-VolumesSnapshotListTestJSON-393538521 None] Lock "cinder-d6daa104-b2e4-4139-81cb-7d4677f0c4f3-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:01 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e Jul 09 15:23:01 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-206f20cb-e23d-46f4-9bd2-01d77187dcb2 req-d27e6796-2c78-4c23-8b8c-bd2f3bd5d65b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:02 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e" returned: 0 in 0.694s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.256s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2042674682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b0f5ee-a6d3-451f-adf2-c7d71fab36b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ddf60e991e40339139f82ed8833ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:57Z,use_quota=True,user_id='2c470f1b434b4479958f7ede6647a87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Creating volume 13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:02 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5aa1a10-c0d7-460d-a8da-696c01a9877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1c3c56-da27-47f1-bca7-06017678388e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:02 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 1073741824 Jul 09 15:23:02 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cd4fe3-3949-48fb-a0fd-63462cbd1b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:02 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume volume-8a1c3c56-da27-47f1-bca7-06017678388e (8a1c3c56-da27-47f1-bca7-06017678388e): created successfully Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cd4fe3-3949-48fb-a0fd-63462cbd1b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:02 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (b7ae541d-8f29-46c8-b9b3-8ad429e553bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:02 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0ab3c6c5-e835-4431-9431-eec26cede445 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created volume successfully. Jul 09 15:23:03 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 1073741824" returned: 0 in 0.876s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:03 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 Jul 09 15:23:03 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:03 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0" returned: 0 in 0.694s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-206f20cb-e23d-46f4-9bd2-01d77187dcb2 req-d27e6796-2c78-4c23-8b8c-bd2f3bd5d65b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.273s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dd1ad4-af6a-4848-9893-0f1aaea0454d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-206f20cb-e23d-46f4-9bd2-01d77187dcb2 req-d27e6796-2c78-4c23-8b8c-bd2f3bd5d65b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5405c2e-9d44-43b7-8543-5f5c6a223141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4edf18-16e3-46a9-98a3-700b4048d499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:03 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Volume volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 (13b0f5ee-a6d3-451f-adf2-c7d71fab36b0): created successfully Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4edf18-16e3-46a9-98a3-700b4048d499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Flow 'volume_create_manager' (87994e13-40c4-4589-883e-5e2d874ecf7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:03 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-539e22e7-6860-4474-b71a-55a28f3afee1 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created volume successfully. Jul 09 15:23:03 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 Jul 09 15:23:03 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Flow 'volume_create_manager' (eba88c60-7357-46c0-9efa-9d87932c35ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97698b4-3611-4622-9660-fb5510a7a4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97698b4-3611-4622-9660-fb5510a7a4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-363170604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177545addfaf4e269ffd2bff137330b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:04Z,use_quota=True,user_id='c01bda234fe74224b4577c52d65528c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072d8846-62ed-4077-ae61-2d27c076aac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072d8846-62ed-4077-ae61-2d27c076aac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4f9fb1-b1f8-4da2-84c1-8a2361d07f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4f9fb1-b1f8-4da2-84c1-8a2361d07f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe', 'volume_name': 'volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c99c538-c7f2-48e6-b423-f9f028531fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c99c538-c7f2-48e6-b423-f9f028531fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9054caa-0b12-42c4-a7cb-d32e67333d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:04 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Volume f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe', 'volume_size': 1} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Flow 'volume_create_manager' (5c6d9db1-7280-46c2-99b9-900342194d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650b5dfd-ef87-4a28-b7b2-9bcb7171b156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650b5dfd-ef87-4a28-b7b2-9bcb7171b156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782661399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff99ccb-f983-4120-b700-f2df576ec520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177545addfaf4e269ffd2bff137330b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:05Z,use_quota=True,user_id='c01bda234fe74224b4577c52d65528c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab5d6ad-23fd-419b-ac8d-8da5720028fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab5d6ad-23fd-419b-ac8d-8da5720028fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3bec5f-b26e-4d1b-afe9-1549b9587bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3bec5f-b26e-4d1b-afe9-1549b9587bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff99ccb-f983-4120-b700-f2df576ec520', 'volume_name': 'volume-0ff99ccb-f983-4120-b700-f2df576ec520', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5481ba9c-8c30-4c2c-b744-7376879e0703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5481ba9c-8c30-4c2c-b744-7376879e0703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22896eb4-eadd-4a99-9c07-ba40d4dd0598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:04 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Volume 0ff99ccb-f983-4120-b700-f2df576ec520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff99ccb-f983-4120-b700-f2df576ec520', 'volume_size': 1} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:04 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [req-206f20cb-e23d-46f4-9bd2-01d77187dcb2 req-d27e6796-2c78-4c23-8b8c-bd2f3bd5d65b tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9" returned: 0 in 0.907s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [req-206f20cb-e23d-46f4-9bd2-01d77187dcb2 req-d27e6796-2c78-4c23-8b8c-bd2f3bd5d65b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.930s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-363170604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177545addfaf4e269ffd2bff137330b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:04Z,use_quota=True,user_id='c01bda234fe74224b4577c52d65528c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Creating volume f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:04 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:04 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe 1073741824 Jul 09 15:23:04 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-206f20cb-e23d-46f4-9bd2-01d77187dcb2 req-d27e6796-2c78-4c23-8b8c-bd2f3bd5d65b tempest-TestServerVolumeAttachmentScenario-1340707866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1', 'name': 'volume-36a10687-baf8-449c-973f-b4cf7e1af8d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23a13dd4-5fac-4fa9-b46b-c3efb8c989c5', 'enforce_multipath': True} {{(pid=87042) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:23:04 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-206f20cb-e23d-46f4-9bd2-01d77187dcb2 req-d27e6796-2c78-4c23-8b8c-bd2f3bd5d65b tempest-TestServerVolumeAttachmentScenario-1340707866 None] attachment_update completed successfully. Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-quobyte-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0" acquired by "delete_volume" :: waited 0.037s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c38020-8067-4b59-aadf-8f8e154b439d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Flow 'volume_create_manager' (16d666b2-6082-426f-8781-568e3bce875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3f392a-2178-40f6-b29b-849eac459da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3f392a-2178-40f6-b29b-849eac459da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-889634109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e58854-fe6d-4b69-a98e-1e8eed6ded2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177545addfaf4e269ffd2bff137330b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:05Z,use_quota=True,user_id='c01bda234fe74224b4577c52d65528c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030d856f-aaf6-4179-9048-696571364f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030d856f-aaf6-4179-9048-696571364f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144dcb02-a4b4-453b-86e8-2b5090b36837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144dcb02-a4b4-453b-86e8-2b5090b36837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e58854-fe6d-4b69-a98e-1e8eed6ded2a', 'volume_name': 'volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1626a425-3fd0-423c-bde0-dd821c360617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1626a425-3fd0-423c-bde0-dd821c360617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88d25a9-e5c6-4d77-8676-129aa2f878de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:05 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Volume 75e58854-fe6d-4b69-a98e-1e8eed6ded2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a', 'volume_size': 1} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:05 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 Jul 09 15:23:05 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Flow 'volume_create_manager' (acb1c2de-e981-4857-89f3-0059954c8b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c083fad8-7f74-4ed1-b2f2-e0edab074c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c083fad8-7f74-4ed1-b2f2-e0edab074c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847275682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e6cc6a-c52c-4839-8f7a-0cc70225d905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177545addfaf4e269ffd2bff137330b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:06Z,use_quota=True,user_id='c01bda234fe74224b4577c52d65528c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea10843-5cab-4918-8e4b-c02b7e04e5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea10843-5cab-4918-8e4b-c02b7e04e5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d02e61b-c8d5-41d2-bda8-9e36ebb10c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d02e61b-c8d5-41d2-bda8-9e36ebb10c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e6cc6a-c52c-4839-8f7a-0cc70225d905', 'volume_name': 'volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466eb396-6bcc-45ba-b983-d69a8a3e700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466eb396-6bcc-45ba-b983-d69a8a3e700a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6633be-36c1-420a-a0d4-6d72ca045819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:05 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Volume c3e6cc6a-c52c-4839-8f7a-0cc70225d905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905', 'volume_size': 1} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:05 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe 1073741824" returned: 0 in 1.232s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:06 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe Jul 09 15:23:06 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Flow 'volume_create_manager' (9187c2b3-ff34-4e06-bf6f-3f3e2dea5d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83a2631-62d0-40f4-a1b3-6abb9417a9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83a2631-62d0-40f4-a1b3-6abb9417a9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166526834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9358f2-192a-40bf-812b-3843c17f9c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177545addfaf4e269ffd2bff137330b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:06Z,use_quota=True,user_id='c01bda234fe74224b4577c52d65528c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bebcdc-5bc8-40e2-880f-b1180089ea46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bebcdc-5bc8-40e2-880f-b1180089ea46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090fe47b-9de3-40bc-919e-9aa50af5ae62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090fe47b-9de3-40bc-919e-9aa50af5ae62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9358f2-192a-40bf-812b-3843c17f9c82', 'volume_name': 'volume-4b9358f2-192a-40bf-812b-3843c17f9c82', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea75a90a-8c70-4568-9d84-73e11ee4e32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea75a90a-8c70-4568-9d84-73e11ee4e32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687d716a-ac6e-489d-8aaa-80aef80de652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:06 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Volume 4b9358f2-192a-40bf-812b-3843c17f9c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9358f2-192a-40bf-812b-3843c17f9c82', 'volume_size': 1} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:06 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0" returned: 0 in 1.047s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:06 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0 Jul 09 15:23:06 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:06 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe" returned: 0 in 0.696s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782661399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff99ccb-f983-4120-b700-f2df576ec520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177545addfaf4e269ffd2bff137330b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:05Z,use_quota=True,user_id='c01bda234fe74224b4577c52d65528c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Creating volume 0ff99ccb-f983-4120-b700-f2df576ec520 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:06 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:06 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520 1073741824 Jul 09 15:23:06 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9054caa-0b12-42c4-a7cb-d32e67333d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa571e4d-9c64-4d64-a99d-4a1314e4cf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:06 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Volume volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe (f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe): created successfully Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa571e4d-9c64-4d64-a99d-4a1314e4cf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Flow 'volume_create_manager' (eba88c60-7357-46c0-9efa-9d87932c35ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:06 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d4eeadc2-1fe9-4139-98f7-16acb87797d1 tempest-CreateVolumesFromImageTest-1632949318 None] Created volume successfully. Jul 09 15:23:06 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0" returned: 0 in 0.677s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0" released by "delete_volume" :: held 1.836s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:06 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created reservations ['68b8a912-fb48-4563-86c0-6232f4239811', '201e109e-4d0e-4b8f-9302-5cae220d304c', '2b71860b-cac6-4dac-839e-126af6107b1a', '6e8ffc9e-a76b-4898-abdb-396ed8828852'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:07 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:07 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-8a1c3c56-da27-47f1-bca7-06017678388e-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-8a1c3c56-da27-47f1-bca7-06017678388e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-quobyte-8a1c3c56-da27-47f1-bca7-06017678388e" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-8a1c3c56-da27-47f1-bca7-06017678388e" acquired by "delete_volume" :: waited 0.038s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c8519d-e4e6-4de4-8033-2e50112980d7]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:07 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e Jul 09 15:23:07 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:07 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520 1073741824" returned: 0 in 0.967s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:07 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520 Jul 09 15:23:07 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:07 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.717s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:07 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Deleted volume successfully. Jul 09 15:23:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-81bd6e4e-b68e-474a-8820-f37d6a8c0df3 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-13b0f5ee-a6d3-451f-adf2-c7d71fab36b0-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:08 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e" returned: 0 in 0.865s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:08 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e Jul 09 15:23:08 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:08 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520" returned: 0 in 0.692s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.104s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-889634109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e58854-fe6d-4b69-a98e-1e8eed6ded2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177545addfaf4e269ffd2bff137330b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:05Z,use_quota=True,user_id='c01bda234fe74224b4577c52d65528c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Creating volume 75e58854-fe6d-4b69-a98e-1e8eed6ded2a {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:08 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22896eb4-eadd-4a99-9c07-ba40d4dd0598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff99ccb-f983-4120-b700-f2df576ec520', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e621b89e-ed2d-4291-b82f-afc5692ca261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:08 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a 1073741824 Jul 09 15:23:08 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:08 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Volume volume-0ff99ccb-f983-4120-b700-f2df576ec520 (0ff99ccb-f983-4120-b700-f2df576ec520): created successfully Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e621b89e-ed2d-4291-b82f-afc5692ca261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Flow 'volume_create_manager' (5c6d9db1-7280-46c2-99b9-900342194d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:08 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0e8c51c0-4dcb-45ef-ae57-af5358842df8 tempest-CreateVolumesFromImageTest-1632949318 None] Created volume successfully. Jul 09 15:23:09 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8a1c3c56-da27-47f1-bca7-06017678388e" returned: 0 in 0.784s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-8a1c3c56-da27-47f1-bca7-06017678388e" released by "delete_volume" :: held 1.698s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created reservations ['3d3e1711-4b50-4bcf-a937-f28b800aa294', '950c5483-a19f-492f-bc21-abd4ed5d88b8', '8f04d91f-39ea-4098-9f95-717f90784ec9', '4e8b7c22-7a28-4003-9a5a-06be4d51b84e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:09 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:09 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:09 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a 1073741824" returned: 0 in 1.125s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-4dfcd730-fbe7-4a0c-8776-78a938d2d08e-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:09 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a Jul 09 15:23:09 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-4dfcd730-fbe7-4a0c-8776-78a938d2d08e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-quobyte-4dfcd730-fbe7-4a0c-8776-78a938d2d08e" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-4dfcd730-fbe7-4a0c-8776-78a938d2d08e" acquired by "delete_volume" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[437959c5-aee8-4cd2-ac99-4ba248722bcc]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:09 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e Jul 09 15:23:09 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:10 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.800s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:10 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Deleted volume successfully. Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-78afcaa0-f28a-4dce-a628-f3753e95bcec tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-8a1c3c56-da27-47f1-bca7-06017678388e-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:10 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a" returned: 0 in 0.671s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.554s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847275682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e6cc6a-c52c-4839-8f7a-0cc70225d905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177545addfaf4e269ffd2bff137330b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:06Z,use_quota=True,user_id='c01bda234fe74224b4577c52d65528c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Creating volume c3e6cc6a-c52c-4839-8f7a-0cc70225d905 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:10 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88d25a9-e5c6-4d77-8676-129aa2f878de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33279e7-a587-4f9c-8ba6-d26ea811c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:10 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905 1073741824 Jul 09 15:23:10 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:10 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Volume volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a (75e58854-fe6d-4b69-a98e-1e8eed6ded2a): created successfully Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33279e7-a587-4f9c-8ba6-d26ea811c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Flow 'volume_create_manager' (16d666b2-6082-426f-8781-568e3bce875c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:10 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-fa5b23e5-30d0-4510-83a5-d98d967e9f10 tempest-CreateVolumesFromImageTest-1632949318 None] Created volume successfully. Jul 09 15:23:10 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e" returned: 0 in 0.789s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:10 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e Jul 09 15:23:10 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:10 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-98fbece2-80a9-4998-aea0-398caeced31b req-2a3fecce-66e2-4446-a7f1-d2a20b322bcb tempest-TestServerVolumeAttachmentScenario-1340707866 None] Terminate volume connection completed successfully. Jul 09 15:23:10 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-98fbece2-80a9-4998-aea0-398caeced31b req-2a3fecce-66e2-4446-a7f1-d2a20b322bcb tempest-TestServerVolumeAttachmentScenario-1340707866 None] Deleting attachment 23a13dd4-5fac-4fa9-b46b-c3efb8c989c5. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:23:11 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905 1073741824" returned: 0 in 0.858s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:11 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905 Jul 09 15:23:11 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:11 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4dfcd730-fbe7-4a0c-8776-78a938d2d08e" returned: 0 in 0.694s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-4dfcd730-fbe7-4a0c-8776-78a938d2d08e" released by "delete_volume" :: held 1.524s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created reservations ['6b85e162-42dd-4f62-9763-c0e4c5ac2c0a', '5708b31b-e4af-40ad-a9c5-3ed62e987abe', '69ff9311-1cbe-479a-9bea-73d90e8f6d9f', '9862c7f6-7b46-4999-93f1-c4a299bd9fa8'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:11 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:11 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:11 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-333bc745-6fa2-4b6e-a682-e02bf52da870-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905" returned: 0 in 0.681s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.659s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166526834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9358f2-192a-40bf-812b-3843c17f9c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177545addfaf4e269ffd2bff137330b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:06Z,use_quota=True,user_id='c01bda234fe74224b4577c52d65528c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Creating volume 4b9358f2-192a-40bf-812b-3843c17f9c82 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:11 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6633be-36c1-420a-a0d4-6d72ca045819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e987e696-614a-48a7-bc52-e733b1864986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:11 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82 1073741824 Jul 09 15:23:11 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-333bc745-6fa2-4b6e-a682-e02bf52da870-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:11 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Volume volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905 (c3e6cc6a-c52c-4839-8f7a-0cc70225d905): created successfully Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e987e696-614a-48a7-bc52-e733b1864986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Flow 'volume_create_manager' (acb1c2de-e981-4857-89f3-0059954c8b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8762ba1f-cc6d-4335-9102-55af8ab66272 tempest-CreateVolumesFromImageTest-1632949318 None] Created volume successfully. Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-quobyte-333bc745-6fa2-4b6e-a682-e02bf52da870" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-333bc745-6fa2-4b6e-a682-e02bf52da870" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:12 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b4f8ea-cb75-45ec-90d3-b0cd4da52bc5]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:12 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.719s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:12 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:12 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Deleted volume successfully. Jul 09 15:23:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e44c9317-db3c-4a53-9e8a-b809c2579fb4 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-4dfcd730-fbe7-4a0c-8776-78a938d2d08e-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:12 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870 Jul 09 15:23:12 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:12 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82 1073741824" returned: 0 in 0.898s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:12 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870" returned: 0 in 0.810s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:12 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82 Jul 09 15:23:12 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:12 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870 Jul 09 15:23:12 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:13 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-333bc745-6fa2-4b6e-a682-e02bf52da870" returned: 0 in 0.689s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:13 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82" returned: 0 in 0.719s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-333bc745-6fa2-4b6e-a682-e02bf52da870" released by "delete_volume" :: held 1.552s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687d716a-ac6e-489d-8aaa-80aef80de652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9358f2-192a-40bf-812b-3843c17f9c82', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67787af5-817e-433e-a911-92afde9cbd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:13 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Volume volume-4b9358f2-192a-40bf-812b-3843c17f9c82 (4b9358f2-192a-40bf-812b-3843c17f9c82): created successfully Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67787af5-817e-433e-a911-92afde9cbd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Flow 'volume_create_manager' (9187c2b3-ff34-4e06-bf6f-3f3e2dea5d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:13 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-94e17511-c7a1-4073-9c62-adcd3174080e tempest-CreateVolumesFromImageTest-1632949318 None] Created volume successfully. Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created reservations ['2774ce49-8869-4a2f-a770-b9d9db4395eb', 'b23b4a05-426c-4e6d-9349-04ea26298cb0', '619c6add-7823-47ad-9bdc-c48248a61da3', '8faed3c1-c403-4eb7-a7af-e64fe83a98af'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:13 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:13 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "cinder-4b9358f2-192a-40bf-812b-3843c17f9c82-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-4b9358f2-192a-40bf-812b-3843c17f9c82-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "cinder-quobyte-4b9358f2-192a-40bf-812b-3843c17f9c82" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-quobyte-4b9358f2-192a-40bf-812b-3843c17f9c82" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2147ea-523e-4a08-a7c6-d6afef83bc60]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:14 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82 Jul 09 15:23:14 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-f858bb3e-8269-4068-8d62-efcdbc6128be-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-f858bb3e-8269-4068-8d62-efcdbc6128be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-quobyte-f858bb3e-8269-4068-8d62-efcdbc6128be" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-f858bb3e-8269-4068-8d62-efcdbc6128be" acquired by "delete_volume" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2820585-fb79-4610-9235-9dc856da5c78]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:14 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be Jul 09 15:23:14 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:14 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.819s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Deleted volume successfully. Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1cea79e7-53e9-46fb-8cc9-858d2b7a1586 tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-333bc745-6fa2-4b6e-a682-e02bf52da870-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [req-52065014-1eb0-4ab9-beed-7f5938038eba req-b4120ae1-7886-42d5-a391-deb70e84bb64 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Terminate volume connection completed successfully. Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [req-52065014-1eb0-4ab9-beed-7f5938038eba req-b4120ae1-7886-42d5-a391-deb70e84bb64 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Deleting attachment 8f4c339a-913e-4f79-afd8-342319ef330c. {{(pid=87042) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:23:14 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82" returned: 0 in 0.876s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:14 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82 Jul 09 15:23:14 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:15 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be" returned: 0 in 0.853s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:15 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be Jul 09 15:23:15 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:15 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4b9358f2-192a-40bf-812b-3843c17f9c82" returned: 0 in 0.682s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-quobyte-4b9358f2-192a-40bf-812b-3843c17f9c82" released by "delete_volume" :: held 1.602s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Created reservations ['b70e8505-74b4-4ed9-8a28-885360219cf1', '1dec96c3-a1a6-4deb-a1bf-85292dd8325e', 'e695f91e-bafe-4c39-8787-74fe17811dcf', 'c83b2958-9cf8-4aa9-b977-c6c82bcbb019'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:15 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:15 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:15 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f858bb3e-8269-4068-8d62-efcdbc6128be" returned: 0 in 0.693s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-f858bb3e-8269-4068-8d62-efcdbc6128be" released by "delete_volume" :: held 1.602s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created reservations ['13161a56-204a-4a08-9a97-11dd85721a3b', 'd005e28e-69d6-4600-9208-fe698965712f', '767402e4-f582-4a26-8ff4-3d31e38bf2af', 'e41da935-a8a5-4419-bac7-0a923168ad5a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:15 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:15 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "cinder-c3e6cc6a-c52c-4839-8f7a-0cc70225d905-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-c3e6cc6a-c52c-4839-8f7a-0cc70225d905-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "cinder-quobyte-c3e6cc6a-c52c-4839-8f7a-0cc70225d905" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-quobyte-c3e6cc6a-c52c-4839-8f7a-0cc70225d905" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8166001e-7454-41c8-bf99-c8dc0d522bcd]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:16 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-243d4de0-2c35-49c4-845e-091b3a2c21af-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.726s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:16 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905 Jul 09 15:23:16 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:16 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Deleted volume successfully. Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-243d4de0-2c35-49c4-845e-091b3a2c21af-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d3d884-1398-4cbb-9c1f-f62ba01041f8 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-4b9358f2-192a-40bf-812b-3843c17f9c82-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "cinder-quobyte-243d4de0-2c35-49c4-845e-091b3a2c21af" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-243d4de0-2c35-49c4-845e-091b3a2c21af" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f088781-523f-4810-b2f0-9e07fd3927f5]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:16 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af Jul 09 15:23:16 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:16 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.817s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:16 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Deleted volume successfully. Jul 09 15:23:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fcfeef91-aa0e-4a93-ab68-11953075c69e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-f858bb3e-8269-4068-8d62-efcdbc6128be-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:17 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905" returned: 0 in 0.956s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:17 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905 Jul 09 15:23:17 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:17 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af" returned: 0 in 0.862s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:17 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af Jul 09 15:23:17 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:17 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c3e6cc6a-c52c-4839-8f7a-0cc70225d905" returned: 0 in 0.689s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-quobyte-c3e6cc6a-c52c-4839-8f7a-0cc70225d905" released by "delete_volume" :: held 1.692s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:17 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Created reservations ['f5ee6f5a-d544-471b-b774-43c1e7ab60c0', 'f6020a3e-1e92-4c7a-8425-014731c0b37c', '60a724dc-5781-4b8b-b968-e3c477921d86', '39116f52-dfb2-4920-88c9-438c01df4dfe'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:18 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:18 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:18 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-243d4de0-2c35-49c4-845e-091b3a2c21af" returned: 0 in 0.699s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-quobyte-243d4de0-2c35-49c4-845e-091b3a2c21af" released by "delete_volume" :: held 1.623s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Created reservations ['7016b006-13e8-42ce-9499-24507234dbfa', '3ae1eb18-4045-4316-b6ce-69bb298a4606', '07dc9172-1975-4a8d-a48c-baa42055eedb', '46bd0f68-5d77-4017-9fe6-013cde869546'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:18 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:18 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "cinder-75e58854-fe6d-4b69-a98e-1e8eed6ded2a-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-75e58854-fe6d-4b69-a98e-1e8eed6ded2a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "cinder-quobyte-75e58854-fe6d-4b69-a98e-1e8eed6ded2a" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-quobyte-75e58854-fe6d-4b69-a98e-1e8eed6ded2a" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7966363b-adcd-4173-9186-512d09839002]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:18 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a Jul 09 15:23:18 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:18 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.977s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:18 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:18 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Deleted volume successfully. Jul 09 15:23:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-8d0da376-46fb-4b73-b490-5df7f8fa422b tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-c3e6cc6a-c52c-4839-8f7a-0cc70225d905-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:19 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.996s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:19 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:19 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Deleted volume successfully. Jul 09 15:23:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-dcbd3415-3ddf-4a67-b4a3-19756e64250e tempest-CreateVolumesFromSourceVolumeTest-1787370839 None] Lock "cinder-243d4de0-2c35-49c4-845e-091b3a2c21af-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:19 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a" returned: 0 in 1.186s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:19 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a Jul 09 15:23:19 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:20 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-75e58854-fe6d-4b69-a98e-1e8eed6ded2a" returned: 0 in 0.762s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-quobyte-75e58854-fe6d-4b69-a98e-1e8eed6ded2a" released by "delete_volume" :: held 2.020s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Created reservations ['0def124f-6563-4789-a344-40f85645a925', '84b58a5f-9274-45d8-9c12-058eda4d1ae0', 'f8c31cdb-b88b-4e22-b738-310703eef5dc', '005626b1-ed0b-43e6-80cc-56c6ceeeeabc'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:20 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:20 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "cinder-0ff99ccb-f983-4120-b700-f2df576ec520-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-0ff99ccb-f983-4120-b700-f2df576ec520-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "cinder-quobyte-0ff99ccb-f983-4120-b700-f2df576ec520" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-quobyte-0ff99ccb-f983-4120-b700-f2df576ec520" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abefd36-bae3-4d22-ae3d-85781f62765e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:20 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520 Jul 09 15:23:20 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:21 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.736s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:21 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:21 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Deleted volume successfully. Jul 09 15:23:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-03fa1e6f-ce64-42c4-bf0b-7c5e4d34a3f9 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-75e58854-fe6d-4b69-a98e-1e8eed6ded2a-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:21 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520" returned: 0 in 0.849s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:21 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520 Jul 09 15:23:21 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:22 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ff99ccb-f983-4120-b700-f2df576ec520" returned: 0 in 0.688s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-quobyte-0ff99ccb-f983-4120-b700-f2df576ec520" released by "delete_volume" :: held 1.580s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Flow 'volume_create_manager' (b0b09aea-84cf-4b2a-bd1d-6bed50293b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe14e89-cc85-4853-978e-617f40e4b84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe14e89-cc85-4853-978e-617f40e4b84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1624342950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f1a84e-99ac-4488-8b58-94738b5f6b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7bab6badf44b24b5e126572ba0a6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:22Z,use_quota=True,user_id='67a740e20e3943ef86b02e4481837a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae81668-8be3-46b8-acea-032ac74272b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae81668-8be3-46b8-acea-032ac74272b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eebd68b-a54f-43cd-b00a-7f5afaa0e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eebd68b-a54f-43cd-b00a-7f5afaa0e835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f1a84e-99ac-4488-8b58-94738b5f6b20', 'volume_name': 'volume-46f1a84e-99ac-4488-8b58-94738b5f6b20', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5132621-e23b-4753-bffb-81bb5df9b9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5132621-e23b-4753-bffb-81bb5df9b9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab51d43c-b8e9-495f-b315-f299aa4ff0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Volume 46f1a84e-99ac-4488-8b58-94738b5f6b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f1a84e-99ac-4488-8b58-94738b5f6b20', 'volume_size': 1} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1624342950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f1a84e-99ac-4488-8b58-94738b5f6b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7bab6badf44b24b5e126572ba0a6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:22Z,use_quota=True,user_id='67a740e20e3943ef86b02e4481837a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Creating volume 46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:22 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:22 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 1073741824 Jul 09 15:23:22 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Created reservations ['407242b2-aac3-4e62-af64-e5797a83bf7f', '273f4dd8-d698-476b-9541-5fb05bea09f7', 'a584b752-05db-4ea8-9781-299c0c1d55d1', '2730b859-f3c9-4e8c-b3e5-032e1cd959e6'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:22 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:22 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "cinder-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "cinder-quobyte-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-quobyte-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790cc5c-8cda-4daf-af94-15f60120783e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:23 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe Jul 09 15:23:23 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:23 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.762s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:23 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:23 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Deleted volume successfully. Jul 09 15:23:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8a99599-47c7-471c-9f3f-2925abd3dbfa tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-0ff99ccb-f983-4120-b700-f2df576ec520-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:23 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 1073741824" returned: 0 in 0.983s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:23 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 Jul 09 15:23:23 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:23 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe" returned: 0 in 0.841s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:23 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe Jul 09 15:23:23 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:24 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20" returned: 0 in 0.712s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab51d43c-b8e9-495f-b315-f299aa4ff0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f1a84e-99ac-4488-8b58-94738b5f6b20', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1584253-cf0c-4478-af6b-2592b55b1f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:24 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Volume volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 (46f1a84e-99ac-4488-8b58-94738b5f6b20): created successfully Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1584253-cf0c-4478-af6b-2592b55b1f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Flow 'volume_create_manager' (b0b09aea-84cf-4b2a-bd1d-6bed50293b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:24 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ae086675-d20c-4f0b-8d7d-a2c38e13366a tempest-VolumeDependencyTests-462305206 None] Created volume successfully. Jul 09 15:23:24 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe" returned: 0 in 0.722s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-quobyte-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe" released by "delete_volume" :: held 1.609s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Created reservations ['48806e86-6bad-4c21-92f6-2f305c6dc315', 'fb34e375-2b66-422b-9ea6-2887b8e246df', '3961aab5-5e14-4614-aad9-0dfda8391567', '9dd0a388-339f-47a1-a02e-3f007d5f5b6a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:24 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:24 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "cinder-36a10687-baf8-449c-973f-b4cf7e1af8d9-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "cinder-36a10687-baf8-449c-973f-b4cf7e1af8d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "cinder-quobyte-36a10687-baf8-449c-973f-b4cf7e1af8d9" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "cinder-quobyte-36a10687-baf8-449c-973f-b4cf7e1af8d9" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1752c7-44d7-4e20-ba0a-b896a16993af]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:25 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 Jul 09 15:23:25 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:25 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.730s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Deleted volume successfully. Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80b4f47f-9191-4e3b-a187-b4153f972505 tempest-CreateVolumesFromImageTest-1632949318 None] Lock "cinder-f0c5a74b-8e0c-48b1-968c-bdc0a74b9abe-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Creating offline snapshot 5e2339ce-230d-48e8-9f98-a1c5bbeca848 of volume 46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0828aae-c5de-4c9b-b57f-ec24571b3c31]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:25 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 Jul 09 15:23:25 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:25 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9" returned: 0 in 0.910s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:26 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9 Jul 09 15:23:26 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:26 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20" returned: 0 in 0.872s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:26 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 1G Jul 09 15:23:26 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:26 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36a10687-baf8-449c-973f-b4cf7e1af8d9" returned: 0 in 0.789s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "cinder-quobyte-36a10687-baf8-449c-973f-b4cf7e1af8d9" released by "delete_volume" :: held 1.761s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Created reservations ['70dbdc62-2fce-4294-afbc-828eef6f1da7', '1ca02364-a694-4f70-be43-b16aeb48c8b3', 'cbda0605-58d2-4b3f-b46e-470dfa0a7a14', '9189ff74-0e3b-4467-92d6-60da64e4d620'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:26 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:26 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "cinder-5b562a6f-4213-4783-841e-9a38bc25bd60-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "cinder-5b562a6f-4213-4783-841e-9a38bc25bd60-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "cinder-quobyte-5b562a6f-4213-4783-841e-9a38bc25bd60" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "cinder-quobyte-5b562a6f-4213-4783-841e-9a38bc25bd60" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbba578-6363-4910-a07b-ad12dff808aa]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:27 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 Jul 09 15:23:27 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:27 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 1G" returned: 0 in 1.004s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:27 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 Jul 09 15:23:27 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:27 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.811s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:27 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Deleted volume successfully. Jul 09 15:23:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fc7af90-19a4-476d-99db-08a27c5e6fc6 tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "cinder-36a10687-baf8-449c-973f-b4cf7e1af8d9-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:28 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60" returned: 0 in 0.846s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:28 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60 Jul 09 15:23:28 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:28 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848" returned: 0 in 0.754s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:28 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 is being set with open permissions: ugo+rw Jul 09 15:23:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:28 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 Jul 09 15:23:28 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:28 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b562a6f-4213-4783-841e-9a38bc25bd60" returned: 0 in 0.703s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "cinder-quobyte-5b562a6f-4213-4783-841e-9a38bc25bd60" released by "delete_volume" :: held 1.595s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:28 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Created reservations ['d37155f2-e948-4bf3-8885-349663f54ff3', '48bb0afe-f518-428b-84ad-f11cfc2d0c4d', '0821bb42-2ff8-434f-aa3d-05972b788aea', '2c123ea0-b221-4f9a-afb8-905b6f22be08'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:29 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848" returned: 0 in 0.693s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:29 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:29 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:29 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.info Jul 09 15:23:29 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:29 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.740s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:29 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Deleted volume successfully. Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-233ffb0f-1003-4b77-8b6e-97047bace9ee tempest-TestServerVolumeAttachmentScenario-1340707866 None] Lock "cinder-5b562a6f-4213-4783-841e-9a38bc25bd60-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:29 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.info" returned: 0 in 0.766s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:29 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.info is being set with open permissions: ugo+rw Jul 09 15:23:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:29 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.info Jul 09 15:23:29 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:30 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.info" returned: 0 in 0.723s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.923s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:30 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a01a3419-f15b-4eb9-b28c-f4abbabb47ae tempest-VolumeDependencyTests-462305206 None] Create snapshot completed successfully Jul 09 15:23:30 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Flow 'volume_create_manager' (dfda2288-b295-4471-acc3-8bbeae191d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1beb3d82-18ed-47f0-b588-b82b2e72a517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1beb3d82-18ed-47f0-b588-b82b2e72a517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ca4575-8750-4f26-a4d9-51d624254593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c0a7adcfde1460491fe227415516ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:31Z,use_quota=True,user_id='9eee6951bcd54ff5b3519fefbc21565e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f50c6fe-52f3-47a9-a6b9-11ea3ece6fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f50c6fe-52f3-47a9-a6b9-11ea3ece6fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889f3367-b2b6-410d-9780-3afee1b9f0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:30 devstack cinder-volume[87042]: DEBUG cinder.image.glance [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Creating Keystone auth plugin from conf {{(pid=87042) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889f3367-b2b6-410d-9780-3afee1b9f0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7ca4575-8750-4f26-a4d9-51d624254593', 'volume_name': 'volume-e7ca4575-8750-4f26-a4d9-51d624254593', 'volume_size': 1, 'image_id': '2561a2b5-f9fa-4f57-8b52-b7e392277000', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2561a2b5-f9fa-4f57-8b52-b7e392277000', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b54230797e57053bc3db71c1a5e54485', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c0a7adcfde1460491fe227415516ce9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34a11a6c0f254be0bc7c5d313880f9e42b0da137a2b3b02d2efefd7627581a8ed5d8dd674939a87625274175137f8e960334236f52eba3028b327f930306dda8', 'id': '2561a2b5-f9fa-4f57-8b52-b7e392277000', 'created_at': datetime.datetime(2026, 7, 9, 13, 23, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 23, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2561a2b5-f9fa-4f57-8b52-b7e392277000/file', 'properties': {}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cd5640-da04-452f-aa50-9d535437798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cd5640-da04-452f-aa50-9d535437798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02fafb5-5296-4e3d-b4d6-7d761b2f9c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:31 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Volume e7ca4575-8750-4f26-a4d9-51d624254593: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7ca4575-8750-4f26-a4d9-51d624254593', 'volume_size': 1, 'image_id': '2561a2b5-f9fa-4f57-8b52-b7e392277000', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2561a2b5-f9fa-4f57-8b52-b7e392277000', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b54230797e57053bc3db71c1a5e54485', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c0a7adcfde1460491fe227415516ce9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34a11a6c0f254be0bc7c5d313880f9e42b0da137a2b3b02d2efefd7627581a8ed5d8dd674939a87625274175137f8e960334236f52eba3028b327f930306dda8', 'id': '2561a2b5-f9fa-4f57-8b52-b7e392277000', 'created_at': datetime.datetime(2026, 7, 9, 13, 23, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 23, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2561a2b5-f9fa-4f57-8b52-b7e392277000/file', 'properties': {}}, 'image_service': } Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Trying to clone e7ca4575-8750-4f26-a4d9-51d624254593 from image 2561a2b5-f9fa-4f57-8b52-b7e392277000 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2561a2b5-f9fa-4f57-8b52-b7e392277000', 'metadata': {}}]). {{(pid=87042) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:23:31 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Image download 0.00 MB at 0.00 MB/s Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Flow 'volume_create_manager' (5ef73715-bbc9-4222-abcb-86b5c14f6a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7550ca35-1c25-4ca6-a831-c03f448efe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7550ca35-1c25-4ca6-a831-c03f448efe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1743124345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e27223-9022-4570-b91d-1e46bd608d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7bab6badf44b24b5e126572ba0a6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5e2339ce-230d-48e8-9f98-a1c5bbeca848,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:32Z,use_quota=True,user_id='67a740e20e3943ef86b02e4481837a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da841c68-4560-442f-87fd-5d000df43d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da841c68-4560-442f-87fd-5d000df43d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fa0429-fb6b-4e9f-86e9-74650e4b40b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fa0429-fb6b-4e9f-86e9-74650e4b40b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06e27223-9022-4570-b91d-1e46bd608d04', 'volume_name': 'volume-06e27223-9022-4570-b91d-1e46bd608d04', 'volume_size': 1, 'snapshot_id': '5e2339ce-230d-48e8-9f98-a1c5bbeca848'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721ff168-187e-4c68-b00a-2d58bbbad66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721ff168-187e-4c68-b00a-2d58bbbad66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5040ef26-573a-48ce-93fe-9b718e6e7c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:31 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Volume 06e27223-9022-4570-b91d-1e46bd608d04: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06e27223-9022-4570-b91d-1e46bd608d04', 'volume_size': 1, 'snapshot_id': '5e2339ce-230d-48e8-9f98-a1c5bbeca848'} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[180000e6-e2d7-44cd-a70a-35ec1995771a]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Acquiring lock "cinder-quobyte-5e2339ce-230d-48e8-9f98-a1c5bbeca848-06e27223-9022-4570-b91d-1e46bd608d04" by "_create_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-5e2339ce-230d-48e8-9f98-a1c5bbeca848-06e27223-9022-4570-b91d-1e46bd608d04" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Creating volume 06e27223-9022-4570-b91d-1e46bd608d04 from snapshot 5e2339ce-230d-48e8-9f98-a1c5bbeca848 {{(pid=87042) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Acquiring lock "cinder-quobyte-06e27223-9022-4570-b91d-1e46bd608d04" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-06e27223-9022-4570-b91d-1e46bd608d04" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] snapshot: 5e2339ce-230d-48e8-9f98-a1c5bbeca848, volume: 06e27223-9022-4570-b91d-1e46bd608d04, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[972a7e44-cfa2-47db-a29e-0a9257c0dbcb]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:31 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD Jul 09 15:23:31 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:31 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 Jul 09 15:23:31 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:32 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD" returned: 0 in 0.809s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:32 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD Jul 09 15:23:32 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:32 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848" returned: 0 in 0.992s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46f1a84e-99ac-4488-8b58-94738b5f6b20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:23:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:23:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:23:32 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[952b6ac3-f1cf-4573-8aaf-18fbc7215e73]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:32 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 Jul 09 15:23:32 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:33 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD" returned: 1 in 0.790s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:33 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Temporary image 2561a2b5-f9fa-4f57-8b52-b7e392277000 is fetched for user 9eee6951bcd54ff5b3519fefbc21565e. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:23:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69e5844-e392-44d5-95d1-d70a4ee6affc]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:33 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD Jul 09 15:23:33 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:33 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20" returned: 0 in 0.908s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:33 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:23:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:33 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 Jul 09 15:23:33 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:34 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:34 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD Jul 09 15:23:34 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:35 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD" returned: 1 in 1.353s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:39 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04" returned: 0 in 5.360s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:39 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[0901dc3e-abb1-4116-9449-5f55bb1195f0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:39 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 Jul 09 15:23:39 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:40 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20" returned: 0 in 1.048s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:23:40 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Converted 1024.00 MB image at 191.02 MB/s Jul 09 15:23:40 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 is being set with open permissions: ugo+rw Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:40 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 Jul 09 15:23:40 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:40 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04" returned: 0 in 0.680s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-06e27223-9022-4570-b91d-1e46bd608d04" released by "_copy_volume_from_snapshot" :: held 9.102s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-5e2339ce-230d-48e8-9f98-a1c5bbeca848-06e27223-9022-4570-b91d-1e46bd608d04" released by "_create_volume_from_snapshot" :: held 9.138s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.157s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.286s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ca4575-8750-4f26-a4d9-51d624254593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c0a7adcfde1460491fe227415516ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:31Z,use_quota=True,user_id='9eee6951bcd54ff5b3519fefbc21565e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Creating volume e7ca4575-8750-4f26-a4d9-51d624254593 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:40 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:40 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 1073741824 Jul 09 15:23:40 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5040ef26-573a-48ce-93fe-9b718e6e7c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e27223-9022-4570-b91d-1e46bd608d04', 'volume_size': 1, 'snapshot_id': '5e2339ce-230d-48e8-9f98-a1c5bbeca848'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f43ac1-494d-4470-9362-22fb713dfcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:41 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Volume volume-06e27223-9022-4570-b91d-1e46bd608d04 (06e27223-9022-4570-b91d-1e46bd608d04): created successfully Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f43ac1-494d-4470-9362-22fb713dfcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Flow 'volume_create_manager' (5ef73715-bbc9-4222-abcb-86b5c14f6a45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9eefda16-fea0-45df-a8cd-b69ec5bf16f4 tempest-VolumeDependencyTests-462305206 None] Created volume successfully. Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Acquiring lock "cinder-5e2339ce-230d-48e8-9f98-a1c5bbeca848-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Lock "cinder-5e2339ce-230d-48e8-9f98-a1c5bbeca848-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Acquiring lock "cinder-quobyte-46f1a84e-99ac-4488-8b58-94738b5f6b20" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-46f1a84e-99ac-4488-8b58-94738b5f6b20" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Acquiring lock "cinder-quobyte-5e2339ce-230d-48e8-9f98-a1c5bbeca848" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-5e2339ce-230d-48e8-9f98-a1c5bbeca848" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Deleting offline snapshot 5e2339ce-230d-48e8-9f98-a1c5bbeca848 of volume 46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] snapshot_file for this snap is: volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a70f47-e832-4c4f-82c7-c58b8fa21215]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:41 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 1073741824" returned: 0 in 0.987s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:41 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 Jul 09 15:23:41 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:41 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 Jul 09 15:23:41 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:42 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593" returned: 0 in 0.715s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:42 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Attempting download of 2561a2b5-f9fa-4f57-8b52-b7e392277000 ((None, [{'url': 'file:///opt/stack/data/glance/images/2561a2b5-f9fa-4f57-8b52-b7e392277000', 'metadata': {}}])) to volume e7ca4575-8750-4f26-a4d9-51d624254593. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:23:42 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848" returned: 0 in 0.843s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:42 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46f1a84e-99ac-4488-8b58-94738b5f6b20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:23:42 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c2fbdb-6e65-4e59-881b-f340d5525c1e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:42 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e54820-2cc2-4e78-896a-70312603897c]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2561a2b5-f9fa-4f57-8b52-b7e392277000_hpgzhczf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:42 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 Jul 09 15:23:42 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:42 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2561a2b5-f9fa-4f57-8b52-b7e392277000_hpgzhczf Jul 09 15:23:42 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:43 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20" returned: 0 in 0.815s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:43 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2561a2b5-f9fa-4f57-8b52-b7e392277000_hpgzhczf" returned: 0 in 0.810s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2561a2b5-f9fa-4f57-8b52-b7e392277000_hpgzhczf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:43 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 Jul 09 15:23:43 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:43 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2561a2b5-f9fa-4f57-8b52-b7e392277000_hpgzhczf Jul 09 15:23:43 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:44 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2561a2b5-f9fa-4f57-8b52-b7e392277000_hpgzhczf" returned: 1 in 0.742s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2561a2b5-f9fa-4f57-8b52-b7e392277000_hpgzhczf' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:44 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[220f564d-fbb9-41f4-8812-7b9a30c74956]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:44 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848" returned: 0 in 0.799s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:44 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848 Jul 09 15:23:44 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:44 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD Jul 09 15:23:44 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:45 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20.5e2339ce-230d-48e8-9f98-a1c5bbeca848" returned: 0 in 0.670s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:45 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD" returned: 0 in 0.743s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-5e2339ce-230d-48e8-9f98-a1c5bbeca848" released by "_delete_snapshot" :: held 3.261s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-46f1a84e-99ac-4488-8b58-94738b5f6b20" released by "delete_snapshot" :: held 3.289s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Created reservations ['922cd2c1-0d0d-4841-b3a5-4ddefd63a0fd', '5b04118b-ba44-440b-8173-4ed97adc0c18', 'da23f2e3-da54-4e99-80f3-a3c9da2d5fc2', '60c543fe-2abc-4d2c-a48c-415bcbc16a31'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:45 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD Jul 09 15:23:45 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Delete snapshot completed successfully. Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-22e98b95-7747-4bed-b380-15bd980228ec tempest-VolumeDependencyTests-462305206 None] Lock "cinder-5e2339ce-230d-48e8-9f98-a1c5bbeca848-delete_snapshot" released by "delete_snapshot" :: held 3.456s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:45 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] 2561a2b5-f9fa-4f57-8b52-b7e392277000 was raw, converting to raw {{(pid=87042) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:23:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:45 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 Jul 09 15:23:45 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Acquiring lock "cinder-46f1a84e-99ac-4488-8b58-94738b5f6b20-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Lock "cinder-46f1a84e-99ac-4488-8b58-94738b5f6b20-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Acquiring lock "cinder-quobyte-46f1a84e-99ac-4488-8b58-94738b5f6b20" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-46f1a84e-99ac-4488-8b58-94738b5f6b20" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a973d0-df9b-4c60-88a8-ddac4fe1fba3]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:46 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 Jul 09 15:23:46 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:46 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593" returned: 0 in 0.836s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:46 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2561a2b5-f9fa-4f57-8b52-b7e392277000_cjd9v87zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:23:46 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 15:23:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:46 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 1G Jul 09 15:23:46 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:47 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20" returned: 0 in 0.872s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:47 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20 Jul 09 15:23:47 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Flow 'volume_create_manager' (c8bccd47-67f3-405e-bf30-84287d254db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815608e7-7fc4-42d4-9a10-3611f74157c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815608e7-7fc4-42d4-9a10-3611f74157c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97769fb5-7e6b-4996-9d83-a715dd3386a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9477f3f6ff674838966c0039d524792c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:47Z,use_quota=True,user_id='39991a2e2c294884ac572da66f0f83f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af57b093-769d-4e87-ba4a-b4295501016e),volume_type_id=af57b093-769d-4e87-ba4a-b4295501016e)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb470c9-8f4e-4918-81bf-4892f917ac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb470c9-8f4e-4918-81bf-4892f917ac53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9295879a-faba-4afa-93ea-5052b7dbd719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.image.glance [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Creating Keystone auth plugin from conf {{(pid=87042) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9295879a-faba-4afa-93ea-5052b7dbd719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97769fb5-7e6b-4996-9d83-a715dd3386a8', 'volume_name': 'volume-97769fb5-7e6b-4996-9d83-a715dd3386a8', 'volume_size': 1, 'image_id': 'f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fed5bc2e4734df53b0970388cde3da09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9477f3f6ff674838966c0039d524792c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00cf35fb0afa58cf07822d4774c2410efa543f9c0c603aeb45f67a1cedc93acbda61c91a62c0f14c7b954a79ded79f0e607d409cbd52567ed76bacca44fb6548', 'id': 'f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'created_at': datetime.datetime(2026, 7, 9, 13, 23, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 23, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48b9c44-fab8-4e77-a652-fbe9d85ad090/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbe6d58-80f5-4b60-a870-f790308f1964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbe6d58-80f5-4b60-a870-f790308f1964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cba836-14b1-496c-9d42-19a7abf5c0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:47 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Volume 97769fb5-7e6b-4996-9d83-a715dd3386a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97769fb5-7e6b-4996-9d83-a715dd3386a8', 'volume_size': 1, 'image_id': 'f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fed5bc2e4734df53b0970388cde3da09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9477f3f6ff674838966c0039d524792c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00cf35fb0afa58cf07822d4774c2410efa543f9c0c603aeb45f67a1cedc93acbda61c91a62c0f14c7b954a79ded79f0e607d409cbd52567ed76bacca44fb6548', 'id': 'f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'created_at': datetime.datetime(2026, 7, 9, 13, 23, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 23, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48b9c44-fab8-4e77-a652-fbe9d85ad090/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Trying to clone 97769fb5-7e6b-4996-9d83-a715dd3386a8 from image f48b9c44-fab8-4e77-a652-fbe9d85ad090 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'metadata': {}}]). {{(pid=87042) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:23:47 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 1G" returned: 0 in 0.795s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:23:47 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Image download 0.00 MB at 0.00 MB/s Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e14124-47b9-456c-a73e-4a4c4631a749]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e118e7c-a5dc-40fd-83c7-72822321f7cd]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:47 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 Jul 09 15:23:47 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:47 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD Jul 09 15:23:47 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:47 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-46f1a84e-99ac-4488-8b58-94738b5f6b20" returned: 0 in 0.676s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-46f1a84e-99ac-4488-8b58-94738b5f6b20" released by "delete_volume" :: held 1.623s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Created reservations ['3db63cc1-e79c-45d4-8af9-17e7b4e032eb', '23d0c728-14b4-4b84-8a92-525a346fc997', '851f87a2-0cb3-4f1c-ac01-aa5e0f982b9c', '8f55b4f3-1e4e-4613-aa4f-028e3fc98c7a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:47 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:47 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Acquiring lock "cinder-06e27223-9022-4570-b91d-1e46bd608d04-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Lock "cinder-06e27223-9022-4570-b91d-1e46bd608d04-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:48 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593" returned: 0 in 0.864s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:48 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Acquiring lock "cinder-quobyte-06e27223-9022-4570-b91d-1e46bd608d04" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD" returned: 0 in 0.847s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-06e27223-9022-4570-b91d-1e46bd608d04" acquired by "delete_volume" :: waited 0.038s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bd8e7f-82e8-4745-9f93-87ea4286f5da]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:48 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD Jul 09 15:23:48 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 Jul 09 15:23:48 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:48 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:48 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.736s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:48 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Deleted volume successfully. Jul 09 15:23:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0be6516-af59-407c-9fda-3d031806cce6 tempest-VolumeDependencyTests-462305206 None] Lock "cinder-46f1a84e-99ac-4488-8b58-94738b5f6b20-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:48 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 Jul 09 15:23:48 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:49 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD" returned: 1 in 0.786s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Temporary image f48b9c44-fab8-4e77-a652-fbe9d85ad090 is fetched for user 39991a2e2c294884ac572da66f0f83f8. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:23:49 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593" returned: 1 in 0.822s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Downloaded image 2561a2b5-f9fa-4f57-8b52-b7e392277000 ((None, [{'url': 'file:///opt/stack/data/glance/images/2561a2b5-f9fa-4f57-8b52-b7e392277000', 'metadata': {}}])) to volume e7ca4575-8750-4f26-a4d9-51d624254593 successfully. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Temporary image 2561a2b5-f9fa-4f57-8b52-b7e392277000 for user 9eee6951bcd54ff5b3519fefbc21565e is deleted. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Marking volume e7ca4575-8750-4f26-a4d9-51d624254593 as bootable. {{(pid=87042) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Copying metadata from image 2561a2b5-f9fa-4f57-8b52-b7e392277000 to e7ca4575-8750-4f26-a4d9-51d624254593. {{(pid=87042) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Creating volume glance metadata for volume e7ca4575-8750-4f26-a4d9-51d624254593 backed by image 2561a2b5-f9fa-4f57-8b52-b7e392277000 with: {'image_id': '2561a2b5-f9fa-4f57-8b52-b7e392277000', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b54230797e57053bc3db71c1a5e54485', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87042) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9912aa-bc37-4310-be07-86cd0e509b8f]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02fafb5-5296-4e3d-b4d6-7d761b2f9c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ca4575-8750-4f26-a4d9-51d624254593', 'volume_size': 1, 'image_id': '2561a2b5-f9fa-4f57-8b52-b7e392277000', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2561a2b5-f9fa-4f57-8b52-b7e392277000', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b54230797e57053bc3db71c1a5e54485', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c0a7adcfde1460491fe227415516ce9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34a11a6c0f254be0bc7c5d313880f9e42b0da137a2b3b02d2efefd7627581a8ed5d8dd674939a87625274175137f8e960334236f52eba3028b327f930306dda8', 'id': '2561a2b5-f9fa-4f57-8b52-b7e392277000', 'created_at': datetime.datetime(2026, 7, 9, 13, 23, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 23, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2561a2b5-f9fa-4f57-8b52-b7e392277000/file', 'properties': {}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3211a5e4-b436-4f16-9239-ac38c008d0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:49 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04" returned: 0 in 0.854s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:49 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Volume volume-e7ca4575-8750-4f26-a4d9-51d624254593 (e7ca4575-8750-4f26-a4d9-51d624254593): created successfully Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3211a5e4-b436-4f16-9239-ac38c008d0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:49 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04 Jul 09 15:23:49 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Flow 'volume_create_manager' (dfda2288-b295-4471-acc3-8bbeae191d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:49 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c50f0dc3-bc1a-45a5-a67d-e847f2b15a9f tempest-VolumeImageDependencyTests-890158658 None] Created volume successfully. Jul 09 15:23:49 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD Jul 09 15:23:49 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Acquiring lock "cinder-e7ca4575-8750-4f26-a4d9-51d624254593-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Lock "cinder-e7ca4575-8750-4f26-a4d9-51d624254593-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Acquiring lock "cinder-quobyte-e7ca4575-8750-4f26-a4d9-51d624254593" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Lock "cinder-quobyte-e7ca4575-8750-4f26-a4d9-51d624254593" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c392a53-ea4e-453e-a2d9-277f5b99b666]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:50 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 Jul 09 15:23:50 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:50 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:50 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD" returned: 0 in 0.820s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-06e27223-9022-4570-b91d-1e46bd608d04" returned: 0 in 0.774s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Lock "cinder-quobyte-06e27223-9022-4570-b91d-1e46bd608d04" released by "delete_volume" :: held 1.689s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Created reservations ['0e9ad9e4-40d6-48ec-ba17-6ced497aebb8', 'f05abc5c-ece5-4dd0-815f-408c09344c42', '57bc446a-07a8-47bd-91f5-ed117ec30b05', '343aaa26-e439-4bd7-b1eb-ae60b6886d17'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:50 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD Jul 09 15:23:50 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:50 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:50 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:50 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593" returned: 0 in 0.841s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:50 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 Jul 09 15:23:50 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:50 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD" returned: 1 in 0.882s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97769fb5-7e6b-4996-9d83-a715dd3386a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9477f3f6ff674838966c0039d524792c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:47Z,use_quota=True,user_id='39991a2e2c294884ac572da66f0f83f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af57b093-769d-4e87-ba4a-b4295501016e),volume_type_id=af57b093-769d-4e87-ba4a-b4295501016e)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Creating volume 97769fb5-7e6b-4996-9d83-a715dd3386a8 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:51 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:51 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.775s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:51 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Deleted volume successfully. Jul 09 15:23:51 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 1073741824 Jul 09 15:23:51 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1ca15c91-d46a-49fe-9846-004255f0346a tempest-VolumeDependencyTests-462305206 None] Lock "cinder-06e27223-9022-4570-b91d-1e46bd608d04-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:51 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593" returned: 1 in 0.879s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:51 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593 Jul 09 15:23:51 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:51 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 1073741824" returned: 0 in 0.921s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:52 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 Jul 09 15:23:52 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:52 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e7ca4575-8750-4f26-a4d9-51d624254593" returned: 0 in 0.805s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Lock "cinder-quobyte-e7ca4575-8750-4f26-a4d9-51d624254593" released by "delete_volume" :: held 2.609s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Created reservations ['5e6535d7-c1ce-481d-9859-132c83ebfe4d', 'e2bebfa3-f2d5-41bd-afe9-1cbdac77f3ab', '3cf79f61-0358-44bc-9808-ca4c039bbd54', 'a51323bb-5577-4eab-ae25-3f14b488f166'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:52 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:23:52 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:52 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8" returned: 0 in 0.737s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Attempting download of f48b9c44-fab8-4e77-a652-fbe9d85ad090 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'metadata': {}}])) to volume 97769fb5-7e6b-4996-9d83-a715dd3386a8. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce189f0-98f4-46ff-b809-4387fd68c765]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48b9c44-fab8-4e77-a652-fbe9d85ad090_c8zuwas1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:52 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48b9c44-fab8-4e77-a652-fbe9d85ad090_c8zuwas1 Jul 09 15:23:52 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:53 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.666s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:53 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:53 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Deleted volume successfully. Jul 09 15:23:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a60e2f7f-2da5-46ea-8f82-07b6edbcb969 tempest-VolumeImageDependencyTests-890158658 None] Lock "cinder-e7ca4575-8750-4f26-a4d9-51d624254593-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:53 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48b9c44-fab8-4e77-a652-fbe9d85ad090_c8zuwas1" returned: 0 in 0.819s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48b9c44-fab8-4e77-a652-fbe9d85ad090_c8zuwas1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:53 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48b9c44-fab8-4e77-a652-fbe9d85ad090_c8zuwas1 Jul 09 15:23:53 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:54 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48b9c44-fab8-4e77-a652-fbe9d85ad090_c8zuwas1" returned: 1 in 0.766s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48b9c44-fab8-4e77-a652-fbe9d85ad090_c8zuwas1' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafcc21a-098f-49fc-bf6e-d617f9e75d09]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:54 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD Jul 09 15:23:54 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:55 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD" returned: 0 in 0.758s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:55 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD Jul 09 15:23:55 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:55 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD" returned: 1 in 0.738s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:55 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] f48b9c44-fab8-4e77-a652-fbe9d85ad090 was raw, converting to raw {{(pid=87042) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:23:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:55 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 Jul 09 15:23:55 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=142,cinder:UPDATE=185,cinder:INSERT=47,cinder:DELETE=15 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=199,cinder:SELECT=141,cinder:INSERT=53,cinder:DELETE=16 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Flow 'volume_create_manager' (1997d771-e883-4cb1-bfcb-d5c5959048c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da16dd9e-198c-489c-a492-0a4f44b1b38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da16dd9e-198c-489c-a492-0a4f44b1b38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b183199-a75d-4017-8dd7-737f25f1f939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a350d70a22743ebb6aa398eea0dad86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:56Z,use_quota=True,user_id='c88f4711fb4b42dfa5414b8887bdef97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3712e4-cd2d-4954-be15-5fc484bde068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3712e4-cd2d-4954-be15-5fc484bde068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb89a0e1-14a1-4867-9b46-a2f948497f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb89a0e1-14a1-4867-9b46-a2f948497f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b183199-a75d-4017-8dd7-737f25f1f939', 'volume_name': 'volume-5b183199-a75d-4017-8dd7-737f25f1f939', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71df5a20-32d9-4b87-b4b4-af8b622efbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71df5a20-32d9-4b87-b4b4-af8b622efbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bfac1be-c6ec-40d9-bff8-e5a506ef7c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:56 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Volume 5b183199-a75d-4017-8dd7-737f25f1f939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b183199-a75d-4017-8dd7-737f25f1f939', 'volume_size': 1} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b183199-a75d-4017-8dd7-737f25f1f939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a350d70a22743ebb6aa398eea0dad86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:56Z,use_quota=True,user_id='c88f4711fb4b42dfa5414b8887bdef97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Creating volume 5b183199-a75d-4017-8dd7-737f25f1f939 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:56 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:56 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939 1073741824 Jul 09 15:23:56 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:56 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8" returned: 0 in 0.778s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f48b9c44-fab8-4e77-a652-fbe9d85ad090_fx7zlii3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:23:56 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 15:23:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:56 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 1G Jul 09 15:23:56 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:57 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939 1073741824" returned: 0 in 0.843s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:57 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939 Jul 09 15:23:57 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:57 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 1G" returned: 0 in 0.733s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6d116b-f42d-4ab4-8bb8-2d867d5491a9]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:57 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 Jul 09 15:23:57 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:57 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939" returned: 0 in 0.671s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bfac1be-c6ec-40d9-bff8-e5a506ef7c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b183199-a75d-4017-8dd7-737f25f1f939', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677f4818-4634-4297-8108-b99a874dd746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:57 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Volume volume-5b183199-a75d-4017-8dd7-737f25f1f939 (5b183199-a75d-4017-8dd7-737f25f1f939): created successfully Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677f4818-4634-4297-8108-b99a874dd746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Flow 'volume_create_manager' (1997d771-e883-4cb1-bfcb-d5c5959048c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:57 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-91564822-4a17-4d2f-8826-06f4ef086bb6 tempest-CinderUnicodeTest-1174274139 None] Created volume successfully. Jul 09 15:23:58 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8" returned: 0 in 0.751s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:58 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 Jul 09 15:23:58 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Flow 'volume_create_manager' (67898020-3957-4f97-82e5-f01860d34030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8466132-97ac-4847-a44f-7d131b75a3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8466132-97ac-4847-a44f-7d131b75a3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-898967405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194ad682-6456-4fb5-913d-90b50d57ec2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a350d70a22743ebb6aa398eea0dad86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:59Z,use_quota=True,user_id='c88f4711fb4b42dfa5414b8887bdef97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea34f107-2009-4801-befe-cf21b508c11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea34f107-2009-4801-befe-cf21b508c11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ac3689-5e33-4cef-8275-d431f1cb6a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ac3689-5e33-4cef-8275-d431f1cb6a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194ad682-6456-4fb5-913d-90b50d57ec2a', 'volume_name': 'volume-194ad682-6456-4fb5-913d-90b50d57ec2a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1f3819-133e-4256-a112-661984efadc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1f3819-133e-4256-a112-661984efadc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f419a33b-1a8d-4902-87dc-4ee077e4999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:58 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Volume 194ad682-6456-4fb5-913d-90b50d57ec2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194ad682-6456-4fb5-913d-90b50d57ec2a', 'volume_size': 1} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-898967405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194ad682-6456-4fb5-913d-90b50d57ec2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a350d70a22743ebb6aa398eea0dad86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:59Z,use_quota=True,user_id='c88f4711fb4b42dfa5414b8887bdef97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Creating volume 194ad682-6456-4fb5-913d-90b50d57ec2a {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:58 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:58 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a 1073741824 Jul 09 15:23:58 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:58 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8" returned: 1 in 0.785s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Downloaded image f48b9c44-fab8-4e77-a652-fbe9d85ad090 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'metadata': {}}])) to volume 97769fb5-7e6b-4996-9d83-a715dd3386a8 successfully. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Temporary image f48b9c44-fab8-4e77-a652-fbe9d85ad090 for user 39991a2e2c294884ac572da66f0f83f8 is deleted. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:23:58 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Marking volume 97769fb5-7e6b-4996-9d83-a715dd3386a8 as bootable. {{(pid=87042) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Copying metadata from image f48b9c44-fab8-4e77-a652-fbe9d85ad090 to 97769fb5-7e6b-4996-9d83-a715dd3386a8. {{(pid=87042) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Creating volume glance metadata for volume 97769fb5-7e6b-4996-9d83-a715dd3386a8 backed by image f48b9c44-fab8-4e77-a652-fbe9d85ad090 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fed5bc2e4734df53b0970388cde3da09', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87042) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cba836-14b1-496c-9d42-19a7abf5c0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97769fb5-7e6b-4996-9d83-a715dd3386a8', 'volume_size': 1, 'image_id': 'f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fed5bc2e4734df53b0970388cde3da09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9477f3f6ff674838966c0039d524792c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00cf35fb0afa58cf07822d4774c2410efa543f9c0c603aeb45f67a1cedc93acbda61c91a62c0f14c7b954a79ded79f0e607d409cbd52567ed76bacca44fb6548', 'id': 'f48b9c44-fab8-4e77-a652-fbe9d85ad090', 'created_at': datetime.datetime(2026, 7, 9, 13, 23, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 23, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48b9c44-fab8-4e77-a652-fbe9d85ad090/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d023fa3c-b98b-4e4e-8220-b92801a61c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:59 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Volume volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 (97769fb5-7e6b-4996-9d83-a715dd3386a8): created successfully Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d023fa3c-b98b-4e4e-8220-b92801a61c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Flow 'volume_create_manager' (c8bccd47-67f3-405e-bf30-84287d254db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:59 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-932e323c-b7c3-4842-a277-73a71c6be7d6 tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Created volume successfully. Jul 09 15:23:59 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a 1073741824" returned: 0 in 0.831s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:59 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a Jul 09 15:23:59 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Acquiring lock "cinder-97769fb5-7e6b-4996-9d83-a715dd3386a8-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Lock "cinder-97769fb5-7e6b-4996-9d83-a715dd3386a8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Acquiring lock "cinder-quobyte-97769fb5-7e6b-4996-9d83-a715dd3386a8" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Lock "cinder-quobyte-97769fb5-7e6b-4996-9d83-a715dd3386a8" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[976435ac-5c43-455c-9f6f-90f2fa43c545]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:00 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 Jul 09 15:24:00 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:00 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a" returned: 0 in 0.651s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f419a33b-1a8d-4902-87dc-4ee077e4999e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194ad682-6456-4fb5-913d-90b50d57ec2a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3c18da-2cd5-470a-b99d-185259aed62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:00 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Volume volume-194ad682-6456-4fb5-913d-90b50d57ec2a (194ad682-6456-4fb5-913d-90b50d57ec2a): created successfully Jul 09 15:24:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3c18da-2cd5-470a-b99d-185259aed62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Flow 'volume_create_manager' (67898020-3957-4f97-82e5-f01860d34030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:00 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2c5ff5bd-57c4-4294-aafe-5153306ce70f tempest-CinderUnicodeTest-1174274139 None] Created volume successfully. Jul 09 15:24:00 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8" returned: 0 in 0.745s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:00 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 Jul 09 15:24:00 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Creating offline snapshot 0830e9e3-fadf-49ff-b694-b190860bc0ac of volume 194ad682-6456-4fb5-913d-90b50d57ec2a {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:24:01 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a42f459-97eb-4efb-8143-4e9a6e61f1c3]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:01 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a Jul 09 15:24:01 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:01 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8" returned: 1 in 0.757s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:24:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:01 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8 Jul 09 15:24:01 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:01 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a" returned: 0 in 0.757s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:01 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac 1G Jul 09 15:24:01 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:02 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-97769fb5-7e6b-4996-9d83-a715dd3386a8" returned: 0 in 0.639s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Lock "cinder-quobyte-97769fb5-7e6b-4996-9d83-a715dd3386a8" released by "delete_volume" :: held 2.202s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:02 devstack cinder-volume[87042]: WARNING cinder.quota [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:24:02 devstack cinder-volume[87042]: WARNING cinder.quota [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Created reservations ['49153589-5678-4a5b-a90c-384e44af878d', '20f8b8b7-7c76-4aef-a1b7-f30e9a302ddf', '2caae909-9f0b-4e76-b714-1cf54bfe90e5', '204560a2-e71d-4186-b03f-f506322b76aa'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:02 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:24:02 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:02 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac 1G" returned: 0 in 0.771s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-194ad682-6456-4fb5-913d-90b50d57ec2a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:02 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-194ad682-6456-4fb5-913d-90b50d57ec2a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac Jul 09 15:24:02 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:02 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.663s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:02 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Deleted volume successfully. Jul 09 15:24:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-652b193f-cf9c-4b9b-8915-f4dda3fc76af tempest-VolumeAndVolumeTypeFromImageTest-1196662687 None] Lock "cinder-97769fb5-7e6b-4996-9d83-a715dd3386a8-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:03 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-194ad682-6456-4fb5-913d-90b50d57ec2a -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac" returned: 0 in 0.701s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:03 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac is being set with open permissions: ugo+rw Jul 09 15:24:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:03 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac Jul 09 15:24:03 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:04 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac" returned: 0 in 0.686s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:04 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.info Jul 09 15:24:04 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:04 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.info" returned: 0 in 0.710s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:04 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.info is being set with open permissions: ugo+rw Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:04 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.info Jul 09 15:24:04 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:04 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:24:04 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:05 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.info" returned: 0 in 0.815s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.539s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:05 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c05ca307-7850-4532-9dac-67eff6c63a73 tempest-CinderUnicodeTest-1174274139 None] Create snapshot completed successfully Jul 09 15:24:05 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.806s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:24:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:24:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:24:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "cinder-0830e9e3-fadf-49ff-b694-b190860bc0ac-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-0830e9e3-fadf-49ff-b694-b190860bc0ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "cinder-quobyte-194ad682-6456-4fb5-913d-90b50d57ec2a" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-quobyte-194ad682-6456-4fb5-913d-90b50d57ec2a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "cinder-quobyte-0830e9e3-fadf-49ff-b694-b190860bc0ac" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-quobyte-0830e9e3-fadf-49ff-b694-b190860bc0ac" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Deleting offline snapshot 0830e9e3-fadf-49ff-b694-b190860bc0ac of volume 194ad682-6456-4fb5-913d-90b50d57ec2a {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:24:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] snapshot_file for this snap is: volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:24:06 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e508a661-4a27-4c27-97ea-1a34b9632bf6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:06 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac Jul 09 15:24:06 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:07 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac" returned: 0 in 0.769s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-194ad682-6456-4fb5-913d-90b50d57ec2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:24:07 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef56e56-c20f-482b-8087-0b801232e0e7]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:07 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a Jul 09 15:24:07 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:08 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a" returned: 0 in 0.802s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:08 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac Jul 09 15:24:08 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:08 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac" returned: 0 in 0.819s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:08 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac Jul 09 15:24:08 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:09 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a.0830e9e3-fadf-49ff-b694-b190860bc0ac" returned: 0 in 0.664s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-quobyte-0830e9e3-fadf-49ff-b694-b190860bc0ac" released by "_delete_snapshot" :: held 3.170s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-quobyte-194ad682-6456-4fb5-913d-90b50d57ec2a" released by "delete_snapshot" :: held 3.197s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:09 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Created reservations ['c8b144b6-fdc8-4183-a1a1-c8e31273f3b2', 'e9890f93-634b-42fa-9004-470f246cde54', 'd3cf041d-bd84-40fd-93bd-1676051c820f', '81e6f830-5565-47f2-993d-ed924b33198b'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Delete snapshot completed successfully. Jul 09 15:24:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6fab0b62-d46f-4d5c-9d11-c3bf7b12af24 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-0830e9e3-fadf-49ff-b694-b190860bc0ac-delete_snapshot" released by "delete_snapshot" :: held 3.369s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "cinder-194ad682-6456-4fb5-913d-90b50d57ec2a-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-194ad682-6456-4fb5-913d-90b50d57ec2a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "cinder-quobyte-194ad682-6456-4fb5-913d-90b50d57ec2a" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-quobyte-194ad682-6456-4fb5-913d-90b50d57ec2a" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:10 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa71b89-1bfb-4b1a-8615-762de88be513]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:10 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a Jul 09 15:24:10 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:11 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a" returned: 0 in 0.801s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:11 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a Jul 09 15:24:11 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:12 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-194ad682-6456-4fb5-913d-90b50d57ec2a" returned: 0 in 0.659s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-quobyte-194ad682-6456-4fb5-913d-90b50d57ec2a" released by "delete_volume" :: held 1.518s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Created reservations ['fc9251dc-70ee-4c22-8aaa-a2f5ff0e1380', '3bd30d5a-9316-4372-b752-2b57f70e8936', '043bdcab-4521-4a54-b2a5-4ebe6cb770c7', 'dbdd368d-416d-4338-9011-3416ab349068'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:12 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:24:12 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "cinder-5b183199-a75d-4017-8dd7-737f25f1f939-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-5b183199-a75d-4017-8dd7-737f25f1f939-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "cinder-quobyte-5b183199-a75d-4017-8dd7-737f25f1f939" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-quobyte-5b183199-a75d-4017-8dd7-737f25f1f939" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:13 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[03137e67-7a64-4115-9bab-623cf429a89f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:13 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.725s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:13 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:13 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Deleted volume successfully. Jul 09 15:24:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0376d803-9b9e-4325-8851-a3949c21d8b3 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-194ad682-6456-4fb5-913d-90b50d57ec2a-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:13 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939 Jul 09 15:24:13 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:13 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939" returned: 0 in 0.858s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:13 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939 Jul 09 15:24:13 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:14 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-5b183199-a75d-4017-8dd7-737f25f1f939" returned: 0 in 0.663s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-quobyte-5b183199-a75d-4017-8dd7-737f25f1f939" released by "delete_volume" :: held 1.577s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:14 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Created reservations ['b94cf2c8-f375-4fce-a7a5-9f63549162ab', '62b3fe45-8eb1-4dea-a458-1676d1751d76', '7018601a-76a2-462b-9c67-b43ef6cf9f9b', '2af56a0d-8b81-4bc4-b4a2-dabd71aa1d75'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:14 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:24:14 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:15 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.702s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:15 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:15 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Deleted volume successfully. Jul 09 15:24:15 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07d17e88-094f-47bc-800a-036f3e1bfe13 tempest-CinderUnicodeTest-1174274139 None] Lock "cinder-5b183199-a75d-4017-8dd7-737f25f1f939-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Flow 'volume_create_manager' (f59c15e7-ef2f-48ab-a82b-447d9c1f8ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca6f412-1dea-4520-a285-029440f9551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca6f412-1dea-4520-a285-029440f9551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262572947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5435070-80d6-40b1-a4ad-97105ef5e57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab8e1ca00214e799ed397538ad0bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:18Z,use_quota=True,user_id='bbad6082959d4de384bc310612204f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636603e1-15b9-4e5d-aef2-ecf90c434be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636603e1-15b9-4e5d-aef2-ecf90c434be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5c7f1c-86da-4dfa-b7b7-40d3880b10b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5c7f1c-86da-4dfa-b7b7-40d3880b10b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5435070-80d6-40b1-a4ad-97105ef5e57e', 'volume_name': 'volume-c5435070-80d6-40b1-a4ad-97105ef5e57e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7b4162-7412-4bf4-a922-f431dfb3bd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7b4162-7412-4bf4-a922-f431dfb3bd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d9dfbf-01dd-48fd-a0a7-2980cbf694dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:18 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Volume c5435070-80d6-40b1-a4ad-97105ef5e57e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5435070-80d6-40b1-a4ad-97105ef5e57e', 'volume_size': 1} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262572947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5435070-80d6-40b1-a4ad-97105ef5e57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab8e1ca00214e799ed397538ad0bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:18Z,use_quota=True,user_id='bbad6082959d4de384bc310612204f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Creating volume c5435070-80d6-40b1-a4ad-97105ef5e57e {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:18 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:24:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:18 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e 1073741824 Jul 09 15:24:18 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:19 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e 1073741824" returned: 0 in 0.917s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:19 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e Jul 09 15:24:19 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:19 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e" returned: 0 in 0.667s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:19 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d9dfbf-01dd-48fd-a0a7-2980cbf694dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5435070-80d6-40b1-a4ad-97105ef5e57e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba86306-f6e3-4fcd-af61-8d67455a359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:19 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Volume volume-c5435070-80d6-40b1-a4ad-97105ef5e57e (c5435070-80d6-40b1-a4ad-97105ef5e57e): created successfully Jul 09 15:24:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba86306-f6e3-4fcd-af61-8d67455a359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:19 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Flow 'volume_create_manager' (f59c15e7-ef2f-48ab-a82b-447d9c1f8ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:19 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-05318013-d17d-47be-89c5-b79b848f2356 tempest-ProjectReaderTests-1233155826 None] Created volume successfully. Jul 09 15:24:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "cinder-c5435070-80d6-40b1-a4ad-97105ef5e57e-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-c5435070-80d6-40b1-a4ad-97105ef5e57e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "cinder-quobyte-c5435070-80d6-40b1-a4ad-97105ef5e57e" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-quobyte-c5435070-80d6-40b1-a4ad-97105ef5e57e" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:20 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ce5960-92b5-4253-807e-40952b1fd354]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:20 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e Jul 09 15:24:20 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:21 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e" returned: 0 in 0.825s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:21 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e Jul 09 15:24:21 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:22 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c5435070-80d6-40b1-a4ad-97105ef5e57e" returned: 0 in 0.736s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-quobyte-c5435070-80d6-40b1-a4ad-97105ef5e57e" released by "delete_volume" :: held 1.620s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Created reservations ['5bde4af4-7c53-4524-8361-3fc0d434bef7', 'ededa7fb-5ee5-4934-bd4e-1da89b4eb0d6', '57725be1-21a6-45fd-8a1b-2d5913e92235', '71b9f021-fc2b-4f12-b088-c2cd317e9b43'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:22 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:24:22 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:22 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.687s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Deleted volume successfully. Jul 09 15:24:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c04c69fd-9533-4e4a-b51f-6ff989462eb6 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-c5435070-80d6-40b1-a4ad-97105ef5e57e-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Flow 'volume_create_manager' (5573922c-f4f9-4887-a089-6de77c293a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b14a7d-a581-4428-8837-7e29979c2638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b14a7d-a581-4428-8837-7e29979c2638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-713956078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcf4bf6-5cf4-4ad5-aaee-37613a632237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab8e1ca00214e799ed397538ad0bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:23Z,use_quota=True,user_id='bbad6082959d4de384bc310612204f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4098c10-24f0-4cb2-aa6f-59d86ee17729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4098c10-24f0-4cb2-aa6f-59d86ee17729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5c040e-8d8c-4f7a-8fd5-bbdff9006317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5c040e-8d8c-4f7a-8fd5-bbdff9006317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fcf4bf6-5cf4-4ad5-aaee-37613a632237', 'volume_name': 'volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fb7b56-d075-4df2-b01d-c486ff1fac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fb7b56-d075-4df2-b01d-c486ff1fac73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341f0f11-ad6f-4c69-bc26-c5ba3e2e302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Volume 2fcf4bf6-5cf4-4ad5-aaee-37613a632237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237', 'volume_size': 1} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-713956078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcf4bf6-5cf4-4ad5-aaee-37613a632237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab8e1ca00214e799ed397538ad0bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:23Z,use_quota=True,user_id='bbad6082959d4de384bc310612204f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Creating volume 2fcf4bf6-5cf4-4ad5-aaee-37613a632237 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:23 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:24:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:23 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237 1073741824 Jul 09 15:24:23 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:24 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237 1073741824" returned: 0 in 0.887s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:24 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237 Jul 09 15:24:24 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:24 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237" returned: 0 in 0.685s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341f0f11-ad6f-4c69-bc26-c5ba3e2e302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834342f1-b908-4289-862d-1e8e51424815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:24 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Volume volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237 (2fcf4bf6-5cf4-4ad5-aaee-37613a632237): created successfully Jul 09 15:24:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834342f1-b908-4289-862d-1e8e51424815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Flow 'volume_create_manager' (5573922c-f4f9-4887-a089-6de77c293a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:24 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d8ed48bb-e98f-46d4-9321-7ff4a3e12f85 tempest-ProjectReaderTests-1233155826 None] Created volume successfully. Jul 09 15:24:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "cinder-2fcf4bf6-5cf4-4ad5-aaee-37613a632237-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-2fcf4bf6-5cf4-4ad5-aaee-37613a632237-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "cinder-quobyte-2fcf4bf6-5cf4-4ad5-aaee-37613a632237" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-quobyte-2fcf4bf6-5cf4-4ad5-aaee-37613a632237" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:25 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2014f9-6a70-4598-bf27-160f26a3a895]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:25 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237 Jul 09 15:24:25 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:26 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237" returned: 0 in 0.791s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:26 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237 Jul 09 15:24:26 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:26 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2fcf4bf6-5cf4-4ad5-aaee-37613a632237" returned: 0 in 0.787s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-quobyte-2fcf4bf6-5cf4-4ad5-aaee-37613a632237" released by "delete_volume" :: held 1.630s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:27 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Created reservations ['00dd2066-2029-421e-85a1-c04ef15cab12', '847ea969-3b7c-40e7-ba62-bd79148754cc', '543a84df-d53a-49c6-8472-99ca9171bdf2', 'b60f4bf2-2d9f-4556-b9fd-595f7fe1204b'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:27 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:24:27 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:27 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.688s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:27 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:27 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Deleted volume successfully. Jul 09 15:24:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1e3b30f7-93f2-4f05-9357-9a23cf1ad422 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-2fcf4bf6-5cf4-4ad5-aaee-37613a632237-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Flow 'volume_create_manager' (7d7f5e8a-d2d2-43c6-9eeb-6e4131672775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744768ea-0e82-4e5a-9cdd-80a3e9575b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744768ea-0e82-4e5a-9cdd-80a3e9575b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370039887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc56f5c2-1323-4463-9901-880c8cff00be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab8e1ca00214e799ed397538ad0bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:28Z,use_quota=True,user_id='bbad6082959d4de384bc310612204f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fcdd97-ec02-4c51-86bb-a39c25e04cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fcdd97-ec02-4c51-86bb-a39c25e04cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdfa04f-85bf-462d-bd55-f66e1c18fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdfa04f-85bf-462d-bd55-f66e1c18fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc56f5c2-1323-4463-9901-880c8cff00be', 'volume_name': 'volume-cc56f5c2-1323-4463-9901-880c8cff00be', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65dac6ca-d32e-46c4-8c47-a86847b89137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65dac6ca-d32e-46c4-8c47-a86847b89137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eaee7b4-b17c-44fd-890a-2550980e6d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:28 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Volume cc56f5c2-1323-4463-9901-880c8cff00be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc56f5c2-1323-4463-9901-880c8cff00be', 'volume_size': 1} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370039887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc56f5c2-1323-4463-9901-880c8cff00be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab8e1ca00214e799ed397538ad0bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:28Z,use_quota=True,user_id='bbad6082959d4de384bc310612204f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Creating volume cc56f5c2-1323-4463-9901-880c8cff00be {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:28 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:24:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:28 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be 1073741824 Jul 09 15:24:28 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:29 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be 1073741824" returned: 0 in 0.936s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:29 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be Jul 09 15:24:29 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:29 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be" returned: 0 in 0.669s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eaee7b4-b17c-44fd-890a-2550980e6d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc56f5c2-1323-4463-9901-880c8cff00be', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e29092d-6db1-4220-864e-ddbf7223ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:29 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Volume volume-cc56f5c2-1323-4463-9901-880c8cff00be (cc56f5c2-1323-4463-9901-880c8cff00be): created successfully Jul 09 15:24:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e29092d-6db1-4220-864e-ddbf7223ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Flow 'volume_create_manager' (7d7f5e8a-d2d2-43c6-9eeb-6e4131672775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:29 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-93fdaf34-188a-4425-95e1-c6190acefb74 tempest-ProjectReaderTests-1233155826 None] Created volume successfully. Jul 09 15:24:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "cinder-cc56f5c2-1323-4463-9901-880c8cff00be-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-cc56f5c2-1323-4463-9901-880c8cff00be-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "cinder-quobyte-cc56f5c2-1323-4463-9901-880c8cff00be" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-quobyte-cc56f5c2-1323-4463-9901-880c8cff00be" acquired by "delete_volume" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:30 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f13835-781c-42c8-8500-0659d4f8a6ec]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:30 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be Jul 09 15:24:30 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:31 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be" returned: 0 in 0.811s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:31 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be Jul 09 15:24:31 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:31 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cc56f5c2-1323-4463-9901-880c8cff00be" returned: 0 in 0.669s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-quobyte-cc56f5c2-1323-4463-9901-880c8cff00be" released by "delete_volume" :: held 1.525s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Created reservations ['1c5ee8ae-fb03-4455-bf21-2677effe8c9a', '922def3e-c366-477c-874a-9f468b1b1e5f', '9c1f75ac-af53-400d-9f4e-6ea90826810e', '25f94167-422c-4596-ae5f-b2b2ea9995fd'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:31 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:24:31 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:32 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.888s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:32 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Deleted volume successfully. Jul 09 15:24:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e9c76c06-3a74-4af9-a350-0b55152cd783 tempest-ProjectReaderTests-1233155826 None] Lock "cinder-cc56f5c2-1323-4463-9901-880c8cff00be-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Flow 'volume_create_manager' (3ffa6840-eebb-45cc-94ce-603a747e8d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78490af6-9941-46e0-bc8d-11e34274b8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78490af6-9941-46e0-bc8d-11e34274b8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387619539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab8e1ca00214e799ed397538ad0bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:33Z,use_quota=True,user_id='bbad6082959d4de384bc310612204f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07c0efa-5188-4e8b-85b5-13e03c6bc77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07c0efa-5188-4e8b-85b5-13e03c6bc77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f302887-1694-4030-8ec6-980e19af9680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f302887-1694-4030-8ec6-980e19af9680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88', 'volume_name': 'volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7104c6f-8ff4-43dc-9d6c-cd674137c5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7104c6f-8ff4-43dc-9d6c-cd674137c5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec49e1b-b898-405a-8d70-bb31d5958685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:33 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Volume 4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88', 'volume_size': 1} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387619539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab8e1ca00214e799ed397538ad0bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:33Z,use_quota=True,user_id='bbad6082959d4de384bc310612204f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Creating volume 4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:33 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:24:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:33 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 1073741824 Jul 09 15:24:33 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:34 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 1073741824" returned: 0 in 0.987s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:34 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 Jul 09 15:24:34 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:34 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88" returned: 0 in 0.668s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec49e1b-b898-405a-8d70-bb31d5958685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4c4ee0-eead-4b36-8a2c-7bdfe04c20fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:34 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Volume volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 (4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88): created successfully Jul 09 15:24:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4c4ee0-eead-4b36-8a2c-7bdfe04c20fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Flow 'volume_create_manager' (3ffa6840-eebb-45cc-94ce-603a747e8d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9bcfa3cf-4268-405f-a5bf-766f06526069 tempest-ProjectReaderTests-1233155826 None] Created volume successfully. Jul 09 15:24:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Acquiring lock "cinder-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Lock "cinder-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Acquiring lock "cinder-quobyte-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Lock "cinder-quobyte-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88" acquired by "delete_volume" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:35 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19ed499-201f-4538-b3eb-7cf7910e12c9]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:35 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 Jul 09 15:24:35 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:36 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88" returned: 0 in 0.939s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:36 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88 Jul 09 15:24:36 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Flow 'volume_create_manager' (b2c8a46d-b450-42a5-984b-7ed4ebf8efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4a9cb1-d650-4a77-9064-85d385932c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4a9cb1-d650-4a77-9064-85d385932c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1594143185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c85505a-14f0-44a5-a2fa-3dca9647f470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f09bdd221ab44e78dc1424d05c4b6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:37Z,use_quota=True,user_id='d689a031acb349f0bb97eb2f606a3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587a56d9-7491-4ead-aeee-828177afa26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587a56d9-7491-4ead-aeee-828177afa26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df4355b-42f6-41d3-bd91-45a76efd566e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df4355b-42f6-41d3-bd91-45a76efd566e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c85505a-14f0-44a5-a2fa-3dca9647f470', 'volume_name': 'volume-6c85505a-14f0-44a5-a2fa-3dca9647f470', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:36 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2e966d-3251-4f20-b453-6a749837c692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2e966d-3251-4f20-b453-6a749837c692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d68a2b1-d748-42bf-8359-4e9a0a071863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:36 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Volume 6c85505a-14f0-44a5-a2fa-3dca9647f470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c85505a-14f0-44a5-a2fa-3dca9647f470', 'volume_size': 1} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1594143185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c85505a-14f0-44a5-a2fa-3dca9647f470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f09bdd221ab44e78dc1424d05c4b6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:37Z,use_quota=True,user_id='d689a031acb349f0bb97eb2f606a3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Creating volume 6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:36 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88" returned: 0 in 0.754s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:36 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 1073741824 Jul 09 15:24:36 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Lock "cinder-quobyte-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88" released by "delete_volume" :: held 1.741s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:36 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Created reservations ['a9bafcad-c33c-4ed4-8909-be666f2b8662', 'a3638c88-b5b0-4d54-9770-bcf416dc07f6', 'c3f745e2-53c6-47c0-9ac5-a56ff13df7be', '1a3347be-1926-4c3d-9ea2-db781905452f'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:37 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:24:37 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:37 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.695s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Deleted volume successfully. Jul 09 15:24:37 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 1073741824" returned: 0 in 0.877s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0fc0088f-ae8f-441a-aedb-7276f63db02b tempest-ProjectReaderTests-1233155826 None] Lock "cinder-4d5cd1d1-eae4-4fbf-bbf4-2f6bec61fe88-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:37 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 Jul 09 15:24:37 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:38 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470" returned: 0 in 0.664s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d68a2b1-d748-42bf-8359-4e9a0a071863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c85505a-14f0-44a5-a2fa-3dca9647f470', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9d98d4-dbe5-4bd3-9cbe-70698c092cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:38 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Volume volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 (6c85505a-14f0-44a5-a2fa-3dca9647f470): created successfully Jul 09 15:24:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9d98d4-dbe5-4bd3-9cbe-70698c092cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Flow 'volume_create_manager' (b2c8a46d-b450-42a5-984b-7ed4ebf8efef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:38 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1da89039-2014-4818-8451-65d289cbc427 tempest-SnapshotDependencyTests-1254454932 None] Created volume successfully. Jul 09 15:24:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Creating offline snapshot d25ae8df-4f44-483b-8ea7-ad7e79997123 of volume 6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:24:39 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e22781-2ed0-445c-bb5c-934e57c77bcd]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:39 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 Jul 09 15:24:39 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:39 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470" returned: 0 in 0.762s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:40 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 1G Jul 09 15:24:40 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:40 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 1G" returned: 0 in 0.754s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:40 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 Jul 09 15:24:40 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:41 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123" returned: 0 in 0.666s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:41 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 is being set with open permissions: ugo+rw Jul 09 15:24:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:41 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 Jul 09 15:24:41 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:42 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123" returned: 0 in 0.643s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:42 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.info Jul 09 15:24:42 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:42 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.info" returned: 0 in 0.655s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:42 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.info is being set with open permissions: ugo+rw Jul 09 15:24:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:42 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.info Jul 09 15:24:42 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:43 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.info" returned: 0 in 0.625s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.193s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:43 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-dfd80dde-3ff6-4f99-98f5-3b97c9a1948f tempest-SnapshotDependencyTests-1254454932 None] Create snapshot completed successfully Jul 09 15:24:44 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Flow 'volume_create_manager' (3c6bfcb2-4048-4cc0-bf35-0268f854ac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47145a7-2e52-4135-a538-18a13415cea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:44 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47145a7-2e52-4135-a538-18a13415cea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19a50a6-01e2-4553-a2c1-4622954dde21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f09bdd221ab44e78dc1424d05c4b6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d25ae8df-4f44-483b-8ea7-ad7e79997123,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:45Z,use_quota=True,user_id='d689a031acb349f0bb97eb2f606a3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2d9234-75ba-4b15-82f9-cda097c7e2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2d9234-75ba-4b15-82f9-cda097c7e2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4eb3c68-daf5-4202-968f-8beb0d5deb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4eb3c68-daf5-4202-968f-8beb0d5deb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e19a50a6-01e2-4553-a2c1-4622954dde21', 'volume_name': 'volume-e19a50a6-01e2-4553-a2c1-4622954dde21', 'volume_size': 1, 'snapshot_id': 'd25ae8df-4f44-483b-8ea7-ad7e79997123'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04dd26f-d439-47e2-9aef-6f3eeb5f22d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04dd26f-d439-47e2-9aef-6f3eeb5f22d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc6ea4b-fbd1-4e29-8791-4f6144051c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:45 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Volume e19a50a6-01e2-4553-a2c1-4622954dde21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e19a50a6-01e2-4553-a2c1-4622954dde21', 'volume_size': 1, 'snapshot_id': 'd25ae8df-4f44-483b-8ea7-ad7e79997123'} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "cinder-quobyte-d25ae8df-4f44-483b-8ea7-ad7e79997123-e19a50a6-01e2-4553-a2c1-4622954dde21" by "_create_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-d25ae8df-4f44-483b-8ea7-ad7e79997123-e19a50a6-01e2-4553-a2c1-4622954dde21" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Creating volume e19a50a6-01e2-4553-a2c1-4622954dde21 from snapshot d25ae8df-4f44-483b-8ea7-ad7e79997123 {{(pid=87042) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "cinder-quobyte-e19a50a6-01e2-4553-a2c1-4622954dde21" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-e19a50a6-01e2-4553-a2c1-4622954dde21" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] snapshot: d25ae8df-4f44-483b-8ea7-ad7e79997123, volume: e19a50a6-01e2-4553-a2c1-4622954dde21, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cf2400-8599-41ba-b923-85c9edf2eae1]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:45 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 Jul 09 15:24:45 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:45 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123" returned: 0 in 0.735s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c85505a-14f0-44a5-a2fa-3dca9647f470(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76548f-ee72-4838-b544-4051999de942]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:45 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 Jul 09 15:24:45 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:46 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470" returned: 0 in 0.734s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:46 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:24:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:46 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 Jul 09 15:24:46 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:50 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21" returned: 0 in 4.364s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:50 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa391d08-e458-4e0d-97f0-edfbffbf8b2c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:51 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 Jul 09 15:24:51 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:51 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470" returned: 0 in 0.907s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:51 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470, size 1024.00 MB, duration 4.37 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:24:51 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Converted 1024.00 MB image at 234.54 MB/s Jul 09 15:24:51 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 is being set with open permissions: ugo+rw Jul 09 15:24:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:51 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 Jul 09 15:24:51 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:52 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21" returned: 0 in 0.629s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-e19a50a6-01e2-4553-a2c1-4622954dde21" released by "_copy_volume_from_snapshot" :: held 7.454s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-d25ae8df-4f44-483b-8ea7-ad7e79997123-e19a50a6-01e2-4553-a2c1-4622954dde21" released by "_create_volume_from_snapshot" :: held 7.483s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.496s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc6ea4b-fbd1-4e29-8791-4f6144051c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19a50a6-01e2-4553-a2c1-4622954dde21', 'volume_size': 1, 'snapshot_id': 'd25ae8df-4f44-483b-8ea7-ad7e79997123'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b1d610-547d-4962-944e-21a563e2d08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:52 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Volume volume-e19a50a6-01e2-4553-a2c1-4622954dde21 (e19a50a6-01e2-4553-a2c1-4622954dde21): created successfully Jul 09 15:24:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b1d610-547d-4962-944e-21a563e2d08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Flow 'volume_create_manager' (3c6bfcb2-4048-4cc0-bf35-0268f854ac19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:52 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e4a0cc10-5354-41df-98af-1e5e13cc4327 tempest-SnapshotDependencyTests-1254454932 None] Created volume successfully. Jul 09 15:24:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "cinder-d25ae8df-4f44-483b-8ea7-ad7e79997123-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-d25ae8df-4f44-483b-8ea7-ad7e79997123-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "cinder-quobyte-6c85505a-14f0-44a5-a2fa-3dca9647f470" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-6c85505a-14f0-44a5-a2fa-3dca9647f470" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "cinder-quobyte-d25ae8df-4f44-483b-8ea7-ad7e79997123" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-d25ae8df-4f44-483b-8ea7-ad7e79997123" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Deleting offline snapshot d25ae8df-4f44-483b-8ea7-ad7e79997123 of volume 6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:24:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] snapshot_file for this snap is: volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:24:53 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[72759a03-61f1-4fd9-9216-de7663beb5db]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:53 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 Jul 09 15:24:53 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:54 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123" returned: 0 in 0.719s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c85505a-14f0-44a5-a2fa-3dca9647f470(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:24:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e51a60d-a382-45f3-ba2c-4a80efa1ea23]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:54 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 Jul 09 15:24:54 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:55 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470" returned: 0 in 0.750s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:55 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 Jul 09 15:24:55 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:55 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123" returned: 0 in 0.721s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:55 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123 Jul 09 15:24:55 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:56 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470.d25ae8df-4f44-483b-8ea7-ad7e79997123" returned: 0 in 0.616s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=62,cinder:UPDATE=102,cinder:DELETE=9,cinder:INSERT=22 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=77,cinder:UPDATE=76,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-d25ae8df-4f44-483b-8ea7-ad7e79997123" released by "_delete_snapshot" :: held 2.912s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-6c85505a-14f0-44a5-a2fa-3dca9647f470" released by "delete_snapshot" :: held 2.934s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Created reservations ['3410487e-15fc-4e2c-a9aa-a5a9d4616d7f', '0e334dcd-d0a0-4892-8d17-9e7263506366', 'a80b24de-cb6b-4631-971d-8f6ba180d84d', 'd3dd308f-0778-4709-8d82-678abb701c89'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:56 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Delete snapshot completed successfully. Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2a893412-c920-4500-bc0c-6380e986f609 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-d25ae8df-4f44-483b-8ea7-ad7e79997123-delete_snapshot" released by "delete_snapshot" :: held 3.072s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "cinder-6c85505a-14f0-44a5-a2fa-3dca9647f470-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-6c85505a-14f0-44a5-a2fa-3dca9647f470-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "cinder-quobyte-6c85505a-14f0-44a5-a2fa-3dca9647f470" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-6c85505a-14f0-44a5-a2fa-3dca9647f470" acquired by "delete_volume" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad65c1f-abf3-498e-ac8d-9a62dc45d6c8]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:56 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 Jul 09 15:24:56 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:57 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470" returned: 0 in 0.746s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:57 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470 Jul 09 15:24:57 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:58 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6c85505a-14f0-44a5-a2fa-3dca9647f470" returned: 0 in 0.645s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-6c85505a-14f0-44a5-a2fa-3dca9647f470" released by "delete_volume" :: held 1.449s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:58 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Created reservations ['f97437a3-4d57-4512-82dd-2f1a27d56219', '8fd4409f-7ddc-4d69-85f1-c51f9d9a5b80', 'ca6b83e6-32c5-4c04-8aec-566b16f3a039', '91bf253c-2ee2-4ea6-b421-05a45f4ebd56'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:58 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:24:58 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "cinder-e19a50a6-01e2-4553-a2c1-4622954dde21-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-e19a50a6-01e2-4553-a2c1-4622954dde21-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:59 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.646s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:59 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Deleted volume successfully. Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "cinder-quobyte-e19a50a6-01e2-4553-a2c1-4622954dde21" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-afd171b8-b740-4333-a699-62d37c945c41 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-6c85505a-14f0-44a5-a2fa-3dca9647f470-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-e19a50a6-01e2-4553-a2c1-4622954dde21" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc68f52-b691-44c9-8354-bf1120741749]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:59 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 Jul 09 15:24:59 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:59 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21" returned: 0 in 0.738s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:59 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21 Jul 09 15:24:59 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:00 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e19a50a6-01e2-4553-a2c1-4622954dde21" returned: 0 in 0.653s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-quobyte-e19a50a6-01e2-4553-a2c1-4622954dde21" released by "delete_volume" :: held 1.429s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:00 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Created reservations ['ea5b9388-9ab8-4630-8443-fe08b916c34c', '5d6bb5e4-2dc5-401b-900e-adda402cef31', 'a32832f7-ca81-46da-af1f-1772f25267a8', '27385e50-c9a7-4479-b513-28b0e0c73dad'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:00 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:00 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:01 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.645s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:01 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:01 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Deleted volume successfully. Jul 09 15:25:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6bcaa3c0-dc2b-4f0b-8f37-90fa25b45f94 tempest-SnapshotDependencyTests-1254454932 None] Lock "cinder-e19a50a6-01e2-4553-a2c1-4622954dde21-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:25:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:04 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:04 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:05 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.658s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:25:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:25:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:25:10 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=16 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:25:11 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Flow 'volume_create_manager' (406037fc-1b96-4266-872f-dff61014e272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13d4367-86e2-4984-afac-fb6f0531a1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13d4367-86e2-4984-afac-fb6f0531a1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1545102105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36656249-3210-4fd9-8ab8-a5a0f1205702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffea2146c4413aac0efabf5e30f092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:20Z,use_quota=True,user_id='4b2d6c2e210c44c8894f5dea0a20dba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1d1d05-1b1f-4b8c-b668-aeb4b323b838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1d1d05-1b1f-4b8c-b668-aeb4b323b838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee921b6e-b8ed-4058-910d-81d7acb3853d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee921b6e-b8ed-4058-910d-81d7acb3853d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36656249-3210-4fd9-8ab8-a5a0f1205702', 'volume_name': 'volume-36656249-3210-4fd9-8ab8-a5a0f1205702', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1764b1-6c79-4358-8af2-b28550eefded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1764b1-6c79-4358-8af2-b28550eefded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1877b493-7f58-4eec-9584-37020907a45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:20 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Volume 36656249-3210-4fd9-8ab8-a5a0f1205702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36656249-3210-4fd9-8ab8-a5a0f1205702', 'volume_size': 1} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1545102105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36656249-3210-4fd9-8ab8-a5a0f1205702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffea2146c4413aac0efabf5e30f092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:20Z,use_quota=True,user_id='4b2d6c2e210c44c8894f5dea0a20dba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Creating volume 36656249-3210-4fd9-8ab8-a5a0f1205702 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:20 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:20 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702 1073741824 Jul 09 15:25:20 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (989d03cd-c93b-4e35-a7a1-b3f850d784a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c97c888-ec7c-46f6-8de2-faef1d412a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Flow 'volume_create_manager' (84175d5f-c6d1-4222-9fe4-f4ba7bb43d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:20 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647b38d9-7ef1-4338-86bc-3bb239bc8340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647b38d9-7ef1-4338-86bc-3bb239bc8340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020681003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8a655e-2fcd-4e41-9392-d6538217d9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffea2146c4413aac0efabf5e30f092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:21Z,use_quota=True,user_id='4b2d6c2e210c44c8894f5dea0a20dba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698e22d0-5e0b-4a43-8ac1-045b0161401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698e22d0-5e0b-4a43-8ac1-045b0161401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea11467-548a-440d-b630-f3b5d512cf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea11467-548a-440d-b630-f3b5d512cf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8a655e-2fcd-4e41-9392-d6538217d9f3', 'volume_name': 'volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5310e3-c881-494c-952e-ec1561f4681d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5310e3-c881-494c-952e-ec1561f4681d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1924d4b3-5f0a-4db5-b7cf-463ef6c6bbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Volume 0f8a655e-2fcd-4e41-9392-d6538217d9f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3', 'volume_size': 1} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c97c888-ec7c-46f6-8de2-faef1d412a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1362772777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423e8f10-008f-4a7e-8df6-9d0ded310f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:21Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce316153-0d00-4147-affd-f71daff1ace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce316153-0d00-4147-affd-f71daff1ace2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc8e3cc-b5ac-4f0d-8781-f39468c2c7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc8e3cc-b5ac-4f0d-8781-f39468c2c7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '423e8f10-008f-4a7e-8df6-9d0ded310f5f', 'volume_name': 'volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdc4c76-2cfe-467e-93ea-82a2f5771fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdc4c76-2cfe-467e-93ea-82a2f5771fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5e7e9c-048b-477d-86e3-d3a1eaa12abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume 423e8f10-008f-4a7e-8df6-9d0ded310f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f', 'volume_size': 1} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:21 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702 1073741824" returned: 0 in 1.186s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Flow 'volume_create_manager' (91ab0ace-d289-4d2b-8f92-837d73ea972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371bfb02-6a0d-40d3-9040-29329eac2703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371bfb02-6a0d-40d3-9040-29329eac2703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1307162978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cefdc3b-f5d5-403c-b6a5-a16232203100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffea2146c4413aac0efabf5e30f092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:21Z,use_quota=True,user_id='4b2d6c2e210c44c8894f5dea0a20dba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d216428d-5de3-439a-95d6-6497fbf85209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d216428d-5de3-439a-95d6-6497fbf85209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4641184-258f-4631-aa99-076a8c8418a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4641184-258f-4631-aa99-076a8c8418a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cefdc3b-f5d5-403c-b6a5-a16232203100', 'volume_name': 'volume-2cefdc3b-f5d5-403c-b6a5-a16232203100', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d11279a-ca0d-4a6e-adf5-a99ce05efc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d11279a-ca0d-4a6e-adf5-a99ce05efc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a04324-a2b2-42f9-bcfa-610ce180ab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Volume 2cefdc3b-f5d5-403c-b6a5-a16232203100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cefdc3b-f5d5-403c-b6a5-a16232203100', 'volume_size': 1} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:21 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702 Jul 09 15:25:21 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (be48bfde-e697-46e4-9235-32d686d39074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f09d2c-796a-456b-a516-cabb3d8e5a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Flow 'volume_create_manager' (5f1ab35a-a0d4-4d4c-9861-d3d79e1a63de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff79102-3e41-4ca1-b566-542447ea2d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff79102-3e41-4ca1-b566-542447ea2d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1754177692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9282ca-1d52-4eff-af4a-fd45092becd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffea2146c4413aac0efabf5e30f092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:22Z,use_quota=True,user_id='4b2d6c2e210c44c8894f5dea0a20dba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060af162-cbe1-4a19-8470-b667e97e764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060af162-cbe1-4a19-8470-b667e97e764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05eb42a7-cc05-4ca7-b319-c8405c9e3eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05eb42a7-cc05-4ca7-b319-c8405c9e3eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9282ca-1d52-4eff-af4a-fd45092becd1', 'volume_name': 'volume-3e9282ca-1d52-4eff-af4a-fd45092becd1', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8e206a-01ab-4b0d-9ef0-bbe3202b23fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8e206a-01ab-4b0d-9ef0-bbe3202b23fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb18a7a7-4806-49de-b8d8-3ed3308ee059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Volume 3e9282ca-1d52-4eff-af4a-fd45092becd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9282ca-1d52-4eff-af4a-fd45092becd1', 'volume_size': 1} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f09d2c-796a-456b-a516-cabb3d8e5a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101237907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c91562-afd7-4a30-9f6b-0babd9aca066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:22Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb3627e-977d-4a23-bed6-8f0805073a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb3627e-977d-4a23-bed6-8f0805073a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18867da5-6dc5-4fae-b007-c718fdeecc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18867da5-6dc5-4fae-b007-c718fdeecc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18c91562-afd7-4a30-9f6b-0babd9aca066', 'volume_name': 'volume-18c91562-afd7-4a30-9f6b-0babd9aca066', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb50373-6951-4498-857c-353f7fe7579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb50373-6951-4498-857c-353f7fe7579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020f93ac-110d-4afb-9214-9066b398188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume 18c91562-afd7-4a30-9f6b-0babd9aca066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18c91562-afd7-4a30-9f6b-0babd9aca066', 'volume_size': 1} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Flow 'volume_create_manager' (42447af1-c2f5-4e2a-85bd-55e85fb0e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fba3d9-3a98-4035-9cbd-c9528cb374b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fba3d9-3a98-4035-9cbd-c9528cb374b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1557737791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d14c3a-2a7b-4863-a02c-d60dac0968b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffea2146c4413aac0efabf5e30f092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:22Z,use_quota=True,user_id='4b2d6c2e210c44c8894f5dea0a20dba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c8f75f-1a2a-41d4-bf6a-ec9f15f659e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c8f75f-1a2a-41d4-bf6a-ec9f15f659e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47270536-4446-4579-8e26-a5add59723d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47270536-4446-4579-8e26-a5add59723d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d14c3a-2a7b-4863-a02c-d60dac0968b5', 'volume_name': 'volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725e9b54-f3d2-41d5-a624-6c6b8247d540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725e9b54-f3d2-41d5-a624-6c6b8247d540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f878f24-c372-46a1-ad59-d3ec24d2e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Volume 38d14c3a-2a7b-4863-a02c-d60dac0968b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5', 'volume_size': 1} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:22 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702" returned: 0 in 0.745s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020681003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8a655e-2fcd-4e41-9392-d6538217d9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffea2146c4413aac0efabf5e30f092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:21Z,use_quota=True,user_id='4b2d6c2e210c44c8894f5dea0a20dba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Creating volume 0f8a655e-2fcd-4e41-9392-d6538217d9f3 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:22 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1877b493-7f58-4eec-9584-37020907a45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36656249-3210-4fd9-8ab8-a5a0f1205702', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3 1073741824 Jul 09 15:25:22 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10457c9-31c6-444f-bf2e-674e4974a65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Volume volume-36656249-3210-4fd9-8ab8-a5a0f1205702 (36656249-3210-4fd9-8ab8-a5a0f1205702): created successfully Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10457c9-31c6-444f-bf2e-674e4974a65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Flow 'volume_create_manager' (406037fc-1b96-4266-872f-dff61014e272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d346e920-5ed6-4ef5-91a1-767fd7037aab tempest-CreateVolumesFromImageTest-2119062316 None] Created volume successfully. Jul 09 15:25:23 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3 1073741824" returned: 0 in 0.883s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:23 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3 Jul 09 15:25:23 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:23 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3" returned: 0 in 0.653s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.856s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1362772777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423e8f10-008f-4a7e-8df6-9d0ded310f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:21Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Creating volume 423e8f10-008f-4a7e-8df6-9d0ded310f5f {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:24 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1924d4b3-5f0a-4db5-b7cf-463ef6c6bbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:24 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f 1073741824 Jul 09 15:25:24 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81530a68-30dc-463f-9306-8b4810d97dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:24 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Volume volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3 (0f8a655e-2fcd-4e41-9392-d6538217d9f3): created successfully Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81530a68-30dc-463f-9306-8b4810d97dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Flow 'volume_create_manager' (84175d5f-c6d1-4222-9fe4-f4ba7bb43d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:24 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a1a608f0-5591-464a-bcfe-e3697139a0b3 tempest-CreateVolumesFromImageTest-2119062316 None] Created volume successfully. Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Flow 'volume_create_manager' (4400fa80-49b4-4098-85e0-c0f2aea7dd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3377b7c9-2c3e-4be9-87a8-c52563aec452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3377b7c9-2c3e-4be9-87a8-c52563aec452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0738284f-7043-4cbb-8ce2-11bf292901f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cfc8a3487e84d1686913b1047d0567a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:24Z,use_quota=True,user_id='97e46b9d28c1477fbd77f26d261df1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f135d9-ecf9-455e-bd95-d00803073154),volume_type_id=b5f135d9-ecf9-455e-bd95-d00803073154)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a030c82e-4f14-4e10-b5d6-607aa564dcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a030c82e-4f14-4e10-b5d6-607aa564dcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74476bbe-a8ec-4037-8624-d761bc9f41e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.image.glance [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Creating Keystone auth plugin from conf {{(pid=87042) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74476bbe-a8ec-4037-8624-d761bc9f41e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0738284f-7043-4cbb-8ce2-11bf292901f5', 'volume_name': 'volume-0738284f-7043-4cbb-8ce2-11bf292901f5', 'volume_size': 1, 'image_id': 'ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1ab6fe77c61be66227e0679bb76ade8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6cfc8a3487e84d1686913b1047d0567a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5b7e2dcdaf79258bebd7e1b156b8dd045398019f75ecc1b5d80253a3a769299799069d12cfa1861e62275c9a3b891fed39c312998fdf0c1078b9d0675895658', 'id': 'ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'created_at': datetime.datetime(2026, 7, 9, 13, 25, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 25, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebf2af57-e0a5-4807-a45e-8fbc1b0131c8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf86b257-17bd-4ce1-b098-eed79af09df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf86b257-17bd-4ce1-b098-eed79af09df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802a1fa0-fee3-4f08-a81b-1636c00c6595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:24 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Volume 0738284f-7043-4cbb-8ce2-11bf292901f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0738284f-7043-4cbb-8ce2-11bf292901f5', 'volume_size': 1, 'image_id': 'ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1ab6fe77c61be66227e0679bb76ade8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6cfc8a3487e84d1686913b1047d0567a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5b7e2dcdaf79258bebd7e1b156b8dd045398019f75ecc1b5d80253a3a769299799069d12cfa1861e62275c9a3b891fed39c312998fdf0c1078b9d0675895658', 'id': 'ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'created_at': datetime.datetime(2026, 7, 9, 13, 25, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 25, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebf2af57-e0a5-4807-a45e-8fbc1b0131c8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Trying to clone 0738284f-7043-4cbb-8ce2-11bf292901f5 from image ebf2af57-e0a5-4807-a45e-8fbc1b0131c8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'metadata': {}}]). {{(pid=87042) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:25:24 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f 1073741824" returned: 0 in 0.893s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:25:24 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Image download 0.00 MB at 0.00 MB/s Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:24 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f Jul 09 15:25:24 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac6b7cd-ae64-41b2-8a47-8e4f816dbc22]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:25 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD Jul 09 15:25:25 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:25 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f" returned: 0 in 0.660s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.956s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1307162978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cefdc3b-f5d5-403c-b6a5-a16232203100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffea2146c4413aac0efabf5e30f092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:21Z,use_quota=True,user_id='4b2d6c2e210c44c8894f5dea0a20dba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Creating volume 2cefdc3b-f5d5-403c-b6a5-a16232203100 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:25 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:25 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100 1073741824 Jul 09 15:25:25 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5e7e9c-048b-477d-86e3-d3a1eaa12abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb88ede7-38c4-4426-93b5-2e68a1595e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:25 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f (423e8f10-008f-4a7e-8df6-9d0ded310f5f): created successfully Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb88ede7-38c4-4426-93b5-2e68a1595e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (989d03cd-c93b-4e35-a7a1-b3f850d784a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8d426bd1-cd3b-4ebd-88bb-b3c702757f74 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created volume successfully. Jul 09 15:25:25 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:25 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD Jul 09 15:25:25 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (98e469a9-0cb2-4e9b-9e85-9b20b32e39bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa977a9-ddc6-4bc2-b8c0-30085210fca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa977a9-ddc6-4bc2-b8c0-30085210fca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-986213352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1813de5-9705-42b9-9cf6-3b966b6b619e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:26Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30aafe3b-626d-45e6-b48e-3d0246ddbba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30aafe3b-626d-45e6-b48e-3d0246ddbba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af99651-a734-452f-bed1-8159607c98f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af99651-a734-452f-bed1-8159607c98f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1813de5-9705-42b9-9cf6-3b966b6b619e', 'volume_name': 'volume-d1813de5-9705-42b9-9cf6-3b966b6b619e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fb0d72-cf26-4e30-ba00-b4a7a827d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fb0d72-cf26-4e30-ba00-b4a7a827d765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cb10fa-20b3-48fa-ba5d-1329be6cf880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:26 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume d1813de5-9705-42b9-9cf6-3b966b6b619e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1813de5-9705-42b9-9cf6-3b966b6b619e', 'volume_size': 1} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:26 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD" returned: 1 in 0.810s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Temporary image ebf2af57-e0a5-4807-a45e-8fbc1b0131c8 is fetched for user 97e46b9d28c1477fbd77f26d261df1d7. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:25:26 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100 1073741824" returned: 0 in 1.038s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e613e9-a14f-4f58-b170-337ce1749412]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:26 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100 Jul 09 15:25:26 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:26 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD Jul 09 15:25:26 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (f72fef48-99c2-477b-8fd9-6403a975f8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea74800-53db-4a87-b23c-2d2454a21b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea74800-53db-4a87-b23c-2d2454a21b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708577344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09693b9a-3c4e-4870-8cbc-06637b117c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:27Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a7fb30-2620-4052-9d71-c1decefd69b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a7fb30-2620-4052-9d71-c1decefd69b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9989909-05c4-44d1-a892-e9d8266b6c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9989909-05c4-44d1-a892-e9d8266b6c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09693b9a-3c4e-4870-8cbc-06637b117c21', 'volume_name': 'volume-09693b9a-3c4e-4870-8cbc-06637b117c21', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4425c3d-88ec-4b60-baa3-80a3adbba3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4425c3d-88ec-4b60-baa3-80a3adbba3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79747794-645f-406e-a040-fc20895d45f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:26 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume 09693b9a-3c4e-4870-8cbc-06637b117c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09693b9a-3c4e-4870-8cbc-06637b117c21', 'volume_size': 1} Jul 09 15:25:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (039758b1-4476-4c24-a136-d8c548da0bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b142c605-0e47-4d6c-9f33-700dd0605597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b142c605-0e47-4d6c-9f33-700dd0605597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1542373539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38b4452-e4f6-4973-afff-747f8214a5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:27Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f54e69-8ae6-48b4-9290-d040d6379520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f54e69-8ae6-48b4-9290-d040d6379520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24866e2b-f2f5-48e2-a5fc-6a10ff170686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24866e2b-f2f5-48e2-a5fc-6a10ff170686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38b4452-e4f6-4973-afff-747f8214a5e4', 'volume_name': 'volume-f38b4452-e4f6-4973-afff-747f8214a5e4', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b89bac-36c5-42fa-af0d-974bed5be41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b89bac-36c5-42fa-af0d-974bed5be41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631fa2ac-b786-4f92-823f-ff68c4f70e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume f38b4452-e4f6-4973-afff-747f8214a5e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38b4452-e4f6-4973-afff-747f8214a5e4', 'volume_size': 1} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:27 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:27 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100" returned: 0 in 0.864s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.601s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1754177692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9282ca-1d52-4eff-af4a-fd45092becd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffea2146c4413aac0efabf5e30f092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:22Z,use_quota=True,user_id='4b2d6c2e210c44c8894f5dea0a20dba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Creating volume 3e9282ca-1d52-4eff-af4a-fd45092becd1 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:27 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:27 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD Jul 09 15:25:27 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:27 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1 1073741824 Jul 09 15:25:27 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a04324-a2b2-42f9-bcfa-610ce180ab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cefdc3b-f5d5-403c-b6a5-a16232203100', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13b9728-b626-4a73-8207-89856c092d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Volume volume-2cefdc3b-f5d5-403c-b6a5-a16232203100 (2cefdc3b-f5d5-403c-b6a5-a16232203100): created successfully Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13b9728-b626-4a73-8207-89856c092d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Flow 'volume_create_manager' (91ab0ace-d289-4d2b-8f92-837d73ea972d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (87481eeb-6fab-4b36-bfbb-cebaf0b1cd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5ea031-4946-444d-ba21-60a38b5a0bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1356a7d1-d5d5-422c-87e8-d843252c7bf8 tempest-CreateVolumesFromImageTest-2119062316 None] Created volume successfully. Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5ea031-4946-444d-ba21-60a38b5a0bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-581670408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a81152a-15af-4b5c-ae4e-22a2b4c916a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:28Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695d041e-9c86-4af3-966c-e3a97da3be0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695d041e-9c86-4af3-966c-e3a97da3be0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1b6f86-22be-4483-b165-c63fc17d039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1b6f86-22be-4483-b165-c63fc17d039c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a81152a-15af-4b5c-ae4e-22a2b4c916a6', 'volume_name': 'volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0ff5f5-a604-497a-b2a0-662711c440ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0ff5f5-a604-497a-b2a0-662711c440ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e359b7-19b2-420d-bc84-57bcec938998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:27 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume 6a81152a-15af-4b5c-ae4e-22a2b4c916a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6', 'volume_size': 1} Jul 09 15:25:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (2b8f77c6-c2f7-48d0-9ebc-21021b66b2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbaa7df-e173-48c1-846f-d2bb7179c833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbaa7df-e173-48c1-846f-d2bb7179c833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286547923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80873e0b-a365-4991-987b-37aedcde16bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:28Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d389466-815d-4f04-8bd9-e02f70b55ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d389466-815d-4f04-8bd9-e02f70b55ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8fe026-c483-480c-bc8f-ec734fcb8d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8fe026-c483-480c-bc8f-ec734fcb8d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80873e0b-a365-4991-987b-37aedcde16bc', 'volume_name': 'volume-80873e0b-a365-4991-987b-37aedcde16bc', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282b8f4a-4589-4903-9158-56fa2f567a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282b8f4a-4589-4903-9158-56fa2f567a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892fc77d-399c-4695-a9ff-6ba738c96e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:28 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume 80873e0b-a365-4991-987b-37aedcde16bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80873e0b-a365-4991-987b-37aedcde16bc', 'volume_size': 1} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:28 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD" returned: 1 in 0.828s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:28 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1 1073741824" returned: 0 in 0.896s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:28 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1 Jul 09 15:25:28 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:29 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1" returned: 0 in 0.655s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.154s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101237907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c91562-afd7-4a30-9f6b-0babd9aca066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:22Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Creating volume 18c91562-afd7-4a30-9f6b-0babd9aca066 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:29 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb18a7a7-4806-49de-b8d8-3ed3308ee059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9282ca-1d52-4eff-af4a-fd45092becd1', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:29 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 1073741824 Jul 09 15:25:29 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f912ddad-3f43-4dca-a4f3-d518e6d89b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:29 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Volume volume-3e9282ca-1d52-4eff-af4a-fd45092becd1 (3e9282ca-1d52-4eff-af4a-fd45092becd1): created successfully Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f912ddad-3f43-4dca-a4f3-d518e6d89b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:29 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Flow 'volume_create_manager' (5f1ab35a-a0d4-4d4c-9861-d3d79e1a63de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:29 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6b4a40f3-7a08-4740-9d15-3b9628489ab7 tempest-CreateVolumesFromImageTest-2119062316 None] Created volume successfully. Jul 09 15:25:30 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 1073741824" returned: 0 in 0.853s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:30 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 Jul 09 15:25:30 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:30 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066" returned: 0 in 0.616s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.443s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1557737791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d14c3a-2a7b-4863-a02c-d60dac0968b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ffea2146c4413aac0efabf5e30f092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:22Z,use_quota=True,user_id='4b2d6c2e210c44c8894f5dea0a20dba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Creating volume 38d14c3a-2a7b-4863-a02c-d60dac0968b5 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:30 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:30 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5 1073741824 Jul 09 15:25:30 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020f93ac-110d-4afb-9214-9066b398188e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c91562-afd7-4a30-9f6b-0babd9aca066', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19730aa4-ee30-409d-b4a5-2e5919c908c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:30 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume volume-18c91562-afd7-4a30-9f6b-0babd9aca066 (18c91562-afd7-4a30-9f6b-0babd9aca066): created successfully Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19730aa4-ee30-409d-b4a5-2e5919c908c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (be48bfde-e697-46e4-9235-32d686d39074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:30 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8273fc21-5590-473a-a75c-db0fcfabcace tempest-CreateVolumesFromSnapshotTest-942461040 None] Created volume successfully. Jul 09 15:25:31 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5 1073741824" returned: 0 in 0.797s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:31 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5 Jul 09 15:25:31 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:32 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5" returned: 0 in 0.674s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.833s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-986213352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1813de5-9705-42b9-9cf6-3b966b6b619e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:26Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Creating volume d1813de5-9705-42b9-9cf6-3b966b6b619e {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:32 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f878f24-c372-46a1-ad59-d3ec24d2e566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:32 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e 1073741824 Jul 09 15:25:32 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5ead37-1efc-4f2d-b4a0-4586561d26cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:32 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Volume volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5 (38d14c3a-2a7b-4863-a02c-d60dac0968b5): created successfully Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5ead37-1efc-4f2d-b4a0-4586561d26cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Flow 'volume_create_manager' (42447af1-c2f5-4e2a-85bd-55e85fb0e957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-fa3170ee-03e3-4d5a-b6ba-ecdb69d527ab tempest-CreateVolumesFromImageTest-2119062316 None] Created volume successfully. Jul 09 15:25:33 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e 1073741824" returned: 0 in 0.804s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:33 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e Jul 09 15:25:33 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "cinder-38d14c3a-2a7b-4863-a02c-d60dac0968b5-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-38d14c3a-2a7b-4863-a02c-d60dac0968b5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "cinder-quobyte-38d14c3a-2a7b-4863-a02c-d60dac0968b5" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-quobyte-38d14c3a-2a7b-4863-a02c-d60dac0968b5" acquired by "delete_volume" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd5665-efff-4ddc-85ec-3a892e9c61e8]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:33 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5 Jul 09 15:25:33 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:33 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e" returned: 0 in 0.664s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.823s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708577344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09693b9a-3c4e-4870-8cbc-06637b117c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:27Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Creating volume 09693b9a-3c4e-4870-8cbc-06637b117c21 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:33 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:33 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21 1073741824 Jul 09 15:25:33 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cb10fa-20b3-48fa-ba5d-1329be6cf880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1813de5-9705-42b9-9cf6-3b966b6b619e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577eb955-451f-4470-88cb-f13473623144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:33 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume volume-d1813de5-9705-42b9-9cf6-3b966b6b619e (d1813de5-9705-42b9-9cf6-3b966b6b619e): created successfully Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577eb955-451f-4470-88cb-f13473623144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:33 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (98e469a9-0cb2-4e9b-9e85-9b20b32e39bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:33 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9faaeb2a-cabf-4338-b9c5-1a4671fc28f4 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created volume successfully. Jul 09 15:25:34 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5" returned: 0 in 0.777s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:34 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5 Jul 09 15:25:34 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:34 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21 1073741824" returned: 0 in 0.840s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:34 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21 Jul 09 15:25:34 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:34 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-38d14c3a-2a7b-4863-a02c-d60dac0968b5" returned: 0 in 0.723s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-quobyte-38d14c3a-2a7b-4863-a02c-d60dac0968b5" released by "delete_volume" :: held 1.546s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Created reservations ['ae772532-55d2-4561-b626-7927b03cc73b', 'c3b6e79d-013c-4ee6-9a02-f80b72953153', '7e8edc2f-6f10-422b-8163-0e06186150d0', '3d5164b5-12fd-4ce3-87a4-3e5f40f5f5a0'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:34 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:34 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:35 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21" returned: 0 in 0.640s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.996s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1542373539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38b4452-e4f6-4973-afff-747f8214a5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:27Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Creating volume f38b4452-e4f6-4973-afff-747f8214a5e4 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:35 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79747794-645f-406e-a040-fc20895d45f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09693b9a-3c4e-4870-8cbc-06637b117c21', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7079a2a7-bffb-4c38-b443-c5a765fe8576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:35 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4 1073741824 Jul 09 15:25:35 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:35 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume volume-09693b9a-3c4e-4870-8cbc-06637b117c21 (09693b9a-3c4e-4870-8cbc-06637b117c21): created successfully Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7079a2a7-bffb-4c38-b443-c5a765fe8576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (f72fef48-99c2-477b-8fd9-6403a975f8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b9f65860-a4ff-4f1b-b1ec-0764c9298724 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created volume successfully. Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "cinder-3e9282ca-1d52-4eff-af4a-fd45092becd1-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-3e9282ca-1d52-4eff-af4a-fd45092becd1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "cinder-quobyte-3e9282ca-1d52-4eff-af4a-fd45092becd1" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-quobyte-3e9282ca-1d52-4eff-af4a-fd45092becd1" acquired by "delete_volume" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[228fb706-5a78-4537-a060-29a8d8d0ab94]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:35 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1 Jul 09 15:25:35 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:35 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.840s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Deleted volume successfully. Jul 09 15:25:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-550449e9-1201-4316-b052-4c03c19618a1 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-38d14c3a-2a7b-4863-a02c-d60dac0968b5-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:36 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4 1073741824" returned: 0 in 0.897s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:36 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4 Jul 09 15:25:36 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:36 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1" returned: 0 in 0.794s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:36 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1 Jul 09 15:25:36 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:36 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4" returned: 0 in 0.664s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.107s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-581670408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a81152a-15af-4b5c-ae4e-22a2b4c916a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:28Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Creating volume 6a81152a-15af-4b5c-ae4e-22a2b4c916a6 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:36 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631fa2ac-b786-4f92-823f-ff68c4f70e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38b4452-e4f6-4973-afff-747f8214a5e4', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:36 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6 1073741824 Jul 09 15:25:36 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a760175-0ddc-45fe-914c-7d1a40a97266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:36 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume volume-f38b4452-e4f6-4973-afff-747f8214a5e4 (f38b4452-e4f6-4973-afff-747f8214a5e4): created successfully Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a760175-0ddc-45fe-914c-7d1a40a97266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (039758b1-4476-4c24-a136-d8c548da0bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-fe42acfd-e4b0-4e6c-8a6d-a05e6b0047c6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created volume successfully. Jul 09 15:25:37 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3e9282ca-1d52-4eff-af4a-fd45092becd1" returned: 0 in 0.671s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-quobyte-3e9282ca-1d52-4eff-af4a-fd45092becd1" released by "delete_volume" :: held 1.517s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Created reservations ['acc7ee9f-32cb-467e-b9d5-8abd21605ffe', 'd76fcbf4-e971-4f49-8614-93e04c7f8cb7', '3e625d75-7641-48a9-9f5e-5c11d3eea0f9', '09bcfa74-066e-466e-b552-9f2b7764814b'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:37 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:37 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "cinder-2cefdc3b-f5d5-403c-b6a5-a16232203100-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-2cefdc3b-f5d5-403c-b6a5-a16232203100-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "cinder-quobyte-2cefdc3b-f5d5-403c-b6a5-a16232203100" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-quobyte-2cefdc3b-f5d5-403c-b6a5-a16232203100" acquired by "delete_volume" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:37 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6 1073741824" returned: 0 in 0.936s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d202d67-fc2e-4c73-ad20-fca9b3876f94]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:37 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.655s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Deleted volume successfully. Jul 09 15:25:37 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6 Jul 09 15:25:37 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-fa4ce645-bd10-4420-a411-846a5ed3c424 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-3e9282ca-1d52-4eff-af4a-fd45092becd1-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:38 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100 Jul 09 15:25:38 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:38 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6" returned: 0 in 0.625s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.369s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286547923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80873e0b-a365-4991-987b-37aedcde16bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c9ced63564737acdfa49ea1aa9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:28Z,use_quota=True,user_id='d0eac87fdfbb404c9ea6cd10d79ee8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Creating volume 80873e0b-a365-4991-987b-37aedcde16bc {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:38 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:38 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc 1073741824 Jul 09 15:25:38 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e359b7-19b2-420d-bc84-57bcec938998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ebdcc9-bc7d-4a3c-8d09-4715649bdfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:38 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6 (6a81152a-15af-4b5c-ae4e-22a2b4c916a6): created successfully Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ebdcc9-bc7d-4a3c-8d09-4715649bdfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (87481eeb-6fab-4b36-bfbb-cebaf0b1cd8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:38 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9da1167a-93d5-4a63-98c6-4b7daf6d0a8a tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created volume successfully. Jul 09 15:25:38 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100" returned: 0 in 0.831s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:38 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100 Jul 09 15:25:38 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:39 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc 1073741824" returned: 0 in 0.802s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:39 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2cefdc3b-f5d5-403c-b6a5-a16232203100" returned: 0 in 0.682s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-quobyte-2cefdc3b-f5d5-403c-b6a5-a16232203100" released by "delete_volume" :: held 1.572s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:39 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc Jul 09 15:25:39 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Created reservations ['7765d9fd-3e85-4c14-aef0-2ca79884ecd8', '9eec8700-1e79-49bf-994c-eaa8396f481e', '50421515-20d5-4809-a999-4d2c61c41595', 'bd0d8e29-a8ca-483f-b213-3356733442f9'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:39 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:39 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "cinder-0f8a655e-2fcd-4e41-9392-d6538217d9f3-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-0f8a655e-2fcd-4e41-9392-d6538217d9f3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "cinder-quobyte-0f8a655e-2fcd-4e41-9392-d6538217d9f3" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-quobyte-0f8a655e-2fcd-4e41-9392-d6538217d9f3" acquired by "delete_volume" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[42938134-68d7-4320-92ab-7eeaf333a3ad]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:40 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc" returned: 0 in 0.727s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.863s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0738284f-7043-4cbb-8ce2-11bf292901f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cfc8a3487e84d1686913b1047d0567a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:24Z,use_quota=True,user_id='97e46b9d28c1477fbd77f26d261df1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f135d9-ecf9-455e-bd95-d00803073154),volume_type_id=b5f135d9-ecf9-455e-bd95-d00803073154)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Creating volume 0738284f-7043-4cbb-8ce2-11bf292901f5 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:40 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892fc77d-399c-4695-a9ff-6ba738c96e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80873e0b-a365-4991-987b-37aedcde16bc', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50025955-c071-432c-88c1-f25e1574f959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:40 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 1073741824 Jul 09 15:25:40 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:40 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Volume volume-80873e0b-a365-4991-987b-37aedcde16bc (80873e0b-a365-4991-987b-37aedcde16bc): created successfully Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50025955-c071-432c-88c1-f25e1574f959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:40 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3 Jul 09 15:25:40 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Flow 'volume_create_manager' (2b8f77c6-c2f7-48d0-9ebc-21021b66b2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:40 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.699s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:40 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3208aa4d-f6f9-488e-8078-2ebb765d6ac2 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created volume successfully. Jul 09 15:25:40 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Deleted volume successfully. Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77dea1fb-51a3-4f7c-914f-01aedebc6c51 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-2cefdc3b-f5d5-403c-b6a5-a16232203100-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:40 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3" returned: 0 in 0.828s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:41 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3 Jul 09 15:25:41 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-80873e0b-a365-4991-987b-37aedcde16bc-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-80873e0b-a365-4991-987b-37aedcde16bc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-quobyte-80873e0b-a365-4991-987b-37aedcde16bc" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:41 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 1073741824" returned: 0 in 0.916s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-80873e0b-a365-4991-987b-37aedcde16bc" acquired by "delete_volume" :: waited 0.036s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b56bcd-80e4-470f-a5de-882aa5fcdb7d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:41 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 Jul 09 15:25:41 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:41 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc Jul 09 15:25:41 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:41 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0f8a655e-2fcd-4e41-9392-d6538217d9f3" returned: 0 in 0.714s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-quobyte-0f8a655e-2fcd-4e41-9392-d6538217d9f3" released by "delete_volume" :: held 1.598s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Created reservations ['698ff953-3ef4-4780-b13d-d68de2593d5b', '011d3a61-60da-4f4e-99d7-6fae4676ce08', 'bb9eed19-9386-42f9-bb81-01e241a356c9', '96a30f6a-eb4c-4fce-ad5a-884ffe3e7abd'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:41 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:41 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:41 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5" returned: 0 in 0.725s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.868s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Creating offline snapshot 0a24ac17-225c-4126-be3f-c74177d01692 of volume 18c91562-afd7-4a30-9f6b-0babd9aca066 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Attempting download of ebf2af57-e0a5-4807-a45e-8fbc1b0131c8 ((None, [{'url': 'file:///opt/stack/data/glance/images/ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'metadata': {}}])) to volume 0738284f-7043-4cbb-8ce2-11bf292901f5. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf45add-9124-4d57-ba38-6cf412a449a4]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:41 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc" returned: 0 in 0.795s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:42 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc Jul 09 15:25:42 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[031b8ad9-a54f-42c3-93ce-7194f23779dc]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_16w92udp {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:42 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 Jul 09 15:25:42 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:42 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_16w92udp Jul 09 15:25:42 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "cinder-36656249-3210-4fd9-8ab8-a5a0f1205702-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-36656249-3210-4fd9-8ab8-a5a0f1205702-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "cinder-quobyte-36656249-3210-4fd9-8ab8-a5a0f1205702" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-quobyte-36656249-3210-4fd9-8ab8-a5a0f1205702" acquired by "delete_volume" :: waited 0.041s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[498d789d-9869-42c9-985d-e3630573354c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:42 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.818s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:42 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Deleted volume successfully. Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e4e18071-60e6-48f9-a62b-8e07ccc23941 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-0f8a655e-2fcd-4e41-9392-d6538217d9f3-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:42 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702 Jul 09 15:25:42 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:42 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066" returned: 0 in 0.924s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:42 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 1G Jul 09 15:25:42 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:42 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_16w92udp" returned: 0 in 0.928s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_16w92udp {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:42 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-80873e0b-a365-4991-987b-37aedcde16bc" returned: 0 in 1.018s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-80873e0b-a365-4991-987b-37aedcde16bc" released by "delete_volume" :: held 1.864s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created reservations ['81bd3cf8-49d7-45c2-8940-e3ae538a3d55', '8f41f001-5cdf-4e13-8760-37fa270788a5', 'fe563bde-fc5f-4b5c-9c61-56ecb97fb169', 'aeb6a844-f310-457c-b772-c2092e0f573d'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:43 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_16w92udp Jul 09 15:25:43 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:43 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:43 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-6a81152a-15af-4b5c-ae4e-22a2b4c916a6-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-6a81152a-15af-4b5c-ae4e-22a2b4c916a6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-quobyte-6a81152a-15af-4b5c-ae4e-22a2b4c916a6" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-6a81152a-15af-4b5c-ae4e-22a2b4c916a6" acquired by "delete_volume" :: waited 0.040s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7497e101-6775-484b-ba40-e1e5053b299b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:43 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702" returned: 0 in 1.091s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:43 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702 Jul 09 15:25:43 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:43 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6 Jul 09 15:25:43 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:43 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_16w92udp" returned: 1 in 0.922s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_16w92udp' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[0337812f-7890-4a8d-8147-4748bdfaeea1]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:43 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 1G" returned: 0 in 1.046s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c91562-afd7-4a30-9f6b-0babd9aca066 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:43 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c91562-afd7-4a30-9f6b-0babd9aca066 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 Jul 09 15:25:43 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:44 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD Jul 09 15:25:44 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:44 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.957s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:44 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Deleted volume successfully. Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-83280bf6-20cd-4b58-b3d2-447ae3f969d6 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-80873e0b-a365-4991-987b-37aedcde16bc-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:44 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36656249-3210-4fd9-8ab8-a5a0f1205702" returned: 0 in 0.803s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-quobyte-36656249-3210-4fd9-8ab8-a5a0f1205702" released by "delete_volume" :: held 1.955s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:44 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6" returned: 0 in 0.901s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Created reservations ['6ff0bd49-77c2-46fd-b312-fad1323fe217', 'a2ef9432-1adb-4e29-b276-3777d62dddda', '292d30ee-d2bd-4e41-900d-3a9b8399dcec', '410afa28-2027-4dfd-92cc-180752f9c614'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:44 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6 Jul 09 15:25:44 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:44 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:44 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:44 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD" returned: 0 in 0.967s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:44 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c91562-afd7-4a30-9f6b-0babd9aca066 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692" returned: 0 in 0.992s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:44 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 is being set with open permissions: ugo+rw Jul 09 15:25:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:44 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 Jul 09 15:25:44 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:45 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD Jul 09 15:25:45 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:45 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6a81152a-15af-4b5c-ae4e-22a2b4c916a6" returned: 0 in 0.885s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-6a81152a-15af-4b5c-ae4e-22a2b4c916a6" released by "delete_volume" :: held 1.853s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:45 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.888s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Deleted volume successfully. Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created reservations ['d58cde44-3635-484b-aac2-4e32ededd087', '1ef94d8e-1951-4a47-9785-76116bc6b770', '7922591c-1d90-475a-9330-ab55971617ec', 'af92f610-ed34-405a-876a-74da3a031e54'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-472c085a-663c-41b2-90f1-ce162fb621a2 tempest-CreateVolumesFromImageTest-2119062316 None] Lock "cinder-36656249-3210-4fd9-8ab8-a5a0f1205702-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-f38b4452-e4f6-4973-afff-747f8214a5e4-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-f38b4452-e4f6-4973-afff-747f8214a5e4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:45 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:45 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-quobyte-f38b4452-e4f6-4973-afff-747f8214a5e4" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-f38b4452-e4f6-4973-afff-747f8214a5e4" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[855351fe-754b-4293-9dfa-93aad281464f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:45 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692" returned: 0 in 1.020s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:46 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4 Jul 09 15:25:46 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:46 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.info Jul 09 15:25:46 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:46 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD" returned: 1 in 1.305s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:25:46 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] ebf2af57-e0a5-4807-a45e-8fbc1b0131c8 was raw, converting to raw {{(pid=87042) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:25:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:46 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 Jul 09 15:25:46 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:46 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.951s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:46 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:46 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Deleted volume successfully. Jul 09 15:25:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-09f2c0bf-17d8-4958-9554-6355990b9097 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-6a81152a-15af-4b5c-ae4e-22a2b4c916a6-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:47 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.info" returned: 0 in 0.974s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:47 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.info is being set with open permissions: ugo+rw Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:47 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4" returned: 0 in 1.140s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:47 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.info Jul 09 15:25:47 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:47 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4 Jul 09 15:25:47 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:47 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5" returned: 0 in 1.165s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ebf2af57-e0a5-4807-a45e-8fbc1b0131c8_867auwwgdevstack@QuobyteHD, size 0.00 MB, duration 1.17 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:25:47 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:47 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 1G Jul 09 15:25:47 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:47 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f38b4452-e4f6-4973-afff-747f8214a5e4" returned: 0 in 0.732s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:47 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.info" returned: 0 in 0.772s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.884s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-f38b4452-e4f6-4973-afff-747f8214a5e4" released by "delete_volume" :: held 1.944s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:47 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7b47f733-0882-4ce1-8cec-51a1bf6d8767 tempest-CreateVolumesFromSnapshotTest-942461040 None] Create snapshot completed successfully Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created reservations ['367174a2-0c9f-42c6-b52a-1ecc42d69cee', '8d0e8263-d1b1-470e-b943-4653ba0c495f', '2309241f-d240-44f5-b4cb-5155d9c9ac13', '57128805-49c0-4bd8-b6c6-0a2d26db2ece'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:48 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:48 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-09693b9a-3c4e-4870-8cbc-06637b117c21-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-09693b9a-3c4e-4870-8cbc-06637b117c21-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-quobyte-09693b9a-3c4e-4870-8cbc-06637b117c21" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-09693b9a-3c4e-4870-8cbc-06637b117c21" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:48 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 1G" returned: 0 in 0.879s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0cea2c-2e47-4607-a4d5-64d73205e29c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ebb196-c481-4b12-b9a8-b7dc1460ca60]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:48 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21 Jul 09 15:25:48 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:48 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 Jul 09 15:25:48 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:48 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.752s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:48 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Deleted volume successfully. Jul 09 15:25:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21c1f3ef-2d9f-4b2f-96dd-dd6cecd01541 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-f38b4452-e4f6-4973-afff-747f8214a5e4-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:49 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21" returned: 0 in 0.912s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:49 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5" returned: 0 in 0.906s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:49 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21 Jul 09 15:25:49 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:49 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 Jul 09 15:25:49 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (0109b6db-ea24-4d06-8ff1-e735e9897aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c0487e-f1a2-4059-8124-8a81415b08fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c0487e-f1a2-4059-8124-8a81415b08fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040079695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ffdb86-fa4f-4c75-af16-bd2b973002d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:49Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9662ba76-7eb9-4227-946d-fcc0a76ce3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9662ba76-7eb9-4227-946d-fcc0a76ce3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61a4f13-4252-4ebb-a059-25b610f32f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61a4f13-4252-4ebb-a059-25b610f32f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ffdb86-fa4f-4c75-af16-bd2b973002d4', 'volume_name': 'volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a3fb4b-0057-4f9f-9b8b-d016ab6298c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a3fb4b-0057-4f9f-9b8b-d016ab6298c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8424420-ab7e-45b4-9715-688a0da7b67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:49 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume 62ffdb86-fa4f-4c75-af16-bd2b973002d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4', 'volume_size': 1} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040079695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ffdb86-fa4f-4c75-af16-bd2b973002d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:49Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Creating volume 62ffdb86-fa4f-4c75-af16-bd2b973002d4 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:49 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:49 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4 1073741824 Jul 09 15:25:49 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:49 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (8d8d16f8-8e81-4be7-8327-3a9de18a4343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebc71cf-d6f4-416b-82d3-fd3bbc50196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebc71cf-d6f4-416b-82d3-fd3bbc50196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343196235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc62b28-2880-4550-8da1-338d56abbb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:50Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c899b3-a159-40ba-8b75-a3c945836c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c899b3-a159-40ba-8b75-a3c945836c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73992d32-0b1d-48a3-916d-693d63c9273a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73992d32-0b1d-48a3-916d-693d63c9273a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc62b28-2880-4550-8da1-338d56abbb48', 'volume_name': 'volume-6dc62b28-2880-4550-8da1-338d56abbb48', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c4d950-7658-485f-bf48-6202ec089e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c4d950-7658-485f-bf48-6202ec089e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c909be3c-a9b0-4cf1-8162-2b9cfdc95f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:50 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume 6dc62b28-2880-4550-8da1-338d56abbb48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc62b28-2880-4550-8da1-338d56abbb48', 'volume_size': 1} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:50 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-09693b9a-3c4e-4870-8cbc-06637b117c21" returned: 0 in 0.950s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-09693b9a-3c4e-4870-8cbc-06637b117c21" released by "delete_volume" :: held 1.931s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created reservations ['13cf5873-42c9-4f2f-b553-9e4234404138', '9577900b-f25b-4ee7-ac97-c8e3ed7d0963', '06714640-1dea-4ccf-b143-1ec9459800a0', 'c96f32a9-0cab-4361-b083-1a464ed369de'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:50 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:50 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-d1813de5-9705-42b9-9cf6-3b966b6b619e-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-d1813de5-9705-42b9-9cf6-3b966b6b619e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:50 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5" returned: 1 in 1.435s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Downloaded image ebf2af57-e0a5-4807-a45e-8fbc1b0131c8 ((None, [{'url': 'file:///opt/stack/data/glance/images/ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'metadata': {}}])) to volume 0738284f-7043-4cbb-8ce2-11bf292901f5 successfully. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Temporary image ebf2af57-e0a5-4807-a45e-8fbc1b0131c8 for user 97e46b9d28c1477fbd77f26d261df1d7 is deleted. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Marking volume 0738284f-7043-4cbb-8ce2-11bf292901f5 as bootable. {{(pid=87042) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Copying metadata from image ebf2af57-e0a5-4807-a45e-8fbc1b0131c8 to 0738284f-7043-4cbb-8ce2-11bf292901f5. {{(pid=87042) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Creating volume glance metadata for volume 0738284f-7043-4cbb-8ce2-11bf292901f5 backed by image ebf2af57-e0a5-4807-a45e-8fbc1b0131c8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e1ab6fe77c61be66227e0679bb76ade8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87042) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-quobyte-d1813de5-9705-42b9-9cf6-3b966b6b619e" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-d1813de5-9705-42b9-9cf6-3b966b6b619e" acquired by "delete_volume" :: waited 0.044s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca14a714-4849-4c0d-bd82-1e0e99b1e8e8]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (89901b81-a5dc-4306-8100-bad6f6543149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:50 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223f1e71-fbea-40dd-bf4f-c44945248f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:50 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e Jul 09 15:25:50 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223f1e71-fbea-40dd-bf4f-c44945248f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672473353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40faa9e-c2ba-49a4-a90b-e23a73371051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:51Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105a381d-d5b2-43fe-ba82-2c6c106e60aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105a381d-d5b2-43fe-ba82-2c6c106e60aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7af1ba-919d-4b3b-beb2-1ca24f6e0632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7af1ba-919d-4b3b-beb2-1ca24f6e0632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40faa9e-c2ba-49a4-a90b-e23a73371051', 'volume_name': 'volume-b40faa9e-c2ba-49a4-a90b-e23a73371051', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ffb355-87ba-4e3a-9165-6e1d2f55f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ffb355-87ba-4e3a-9165-6e1d2f55f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160316b9-9f00-4572-9b9f-07134969056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:51 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume b40faa9e-c2ba-49a4-a90b-e23a73371051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40faa9e-c2ba-49a4-a90b-e23a73371051', 'volume_size': 1} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802a1fa0-fee3-4f08-a81b-1636c00c6595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0738284f-7043-4cbb-8ce2-11bf292901f5', 'volume_size': 1, 'image_id': 'ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1ab6fe77c61be66227e0679bb76ade8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6cfc8a3487e84d1686913b1047d0567a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5b7e2dcdaf79258bebd7e1b156b8dd045398019f75ecc1b5d80253a3a769299799069d12cfa1861e62275c9a3b891fed39c312998fdf0c1078b9d0675895658', 'id': 'ebf2af57-e0a5-4807-a45e-8fbc1b0131c8', 'created_at': datetime.datetime(2026, 7, 9, 13, 25, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 25, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebf2af57-e0a5-4807-a45e-8fbc1b0131c8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e05543d-cc31-4345-9826-7dc2c3657f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:51 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Volume volume-0738284f-7043-4cbb-8ce2-11bf292901f5 (0738284f-7043-4cbb-8ce2-11bf292901f5): created successfully Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e05543d-cc31-4345-9826-7dc2c3657f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Flow 'volume_create_manager' (4400fa80-49b4-4098-85e0-c0f2aea7dd9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:51 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-76093362-0a40-486e-8003-cf7d4617a73e tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Created volume successfully. Jul 09 15:25:51 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4 1073741824" returned: 0 in 1.455s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:51 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4 Jul 09 15:25:51 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:51 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.036s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:51 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Deleted volume successfully. Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-0645cd38-7049-43bb-be28-c91fb658b0e5 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-09693b9a-3c4e-4870-8cbc-06637b117c21-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (fd6a28a5-e514-46d5-ac63-d2f0ff06e45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0481a6c5-c3f5-470b-95eb-c0b9aff72326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0481a6c5-c3f5-470b-95eb-c0b9aff72326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101784203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2591953e-0726-4f6e-9680-5e1aa9f6a88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:51Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33e0239-0ae7-4779-b064-748fa16905a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33e0239-0ae7-4779-b064-748fa16905a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3193c28-239c-495d-a67f-c5461c5009f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3193c28-239c-495d-a67f-c5461c5009f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2591953e-0726-4f6e-9680-5e1aa9f6a88a', 'volume_name': 'volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c915f8b-4779-461e-9173-7a713070d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c915f8b-4779-461e-9173-7a713070d249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d65bae-0ad2-49e8-88ad-dbfeebdf8eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:51 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume 2591953e-0726-4f6e-9680-5e1aa9f6a88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a', 'volume_size': 1} Jul 09 15:25:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Acquiring lock "cinder-0738284f-7043-4cbb-8ce2-11bf292901f5-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Lock "cinder-0738284f-7043-4cbb-8ce2-11bf292901f5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:52 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e" returned: 0 in 1.327s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Acquiring lock "cinder-quobyte-0738284f-7043-4cbb-8ce2-11bf292901f5" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:52 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Lock "cinder-quobyte-0738284f-7043-4cbb-8ce2-11bf292901f5" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:52 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:52 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4" returned: 0 in 1.018s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] <== create_volume: return (2531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.537s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ccc54-ac96-4f82-a24c-44f54758055c]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.190s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343196235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc62b28-2880-4550-8da1-338d56abbb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:50Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Creating volume 6dc62b28-2880-4550-8da1-338d56abbb48 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:52 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8424420-ab7e-45b4-9715-688a0da7b67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6567f3-9d02-4714-b373-3887946429a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48 1073741824 Jul 09 15:25:52 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:52 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4 (62ffdb86-fa4f-4c75-af16-bd2b973002d4): created successfully Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6567f3-9d02-4714-b373-3887946429a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (0109b6db-ea24-4d06-8ff1-e735e9897aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:52 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7f61cbde-f9a2-4726-9d96-823d9c1d4060 tempest-CreateVolumesFromSnapshotTest-942461040 None] Created volume successfully. Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (82d26d48-9eef-4faa-9ef1-eac39a0e823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49291d7-9c15-407a-a1cc-2b08dca1a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:25:52 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 Jul 09 15:25:52 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Flow 'volume_create_manager' (a14b7e48-754f-47a6-9ab3-95454f71a8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5f4415-1d96-442f-97b2-d2a7e645223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49291d7-9c15-407a-a1cc-2b08dca1a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730046665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b425f4-cff4-49dc-9fda-f879732c9034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:52Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc95881-0a27-4688-a9ea-c7e1f6e66d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc95881-0a27-4688-a9ea-c7e1f6e66d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83fcfc2e-716a-4a33-9972-60da4a66cf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83fcfc2e-716a-4a33-9972-60da4a66cf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b425f4-cff4-49dc-9fda-f879732c9034', 'volume_name': 'volume-72b425f4-cff4-49dc-9fda-f879732c9034', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0f8f5e-9897-46b2-bf7b-7544fdb52b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0f8f5e-9897-46b2-bf7b-7544fdb52b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd04976-e339-4efa-be44-96e3f0bf823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume 72b425f4-cff4-49dc-9fda-f879732c9034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b425f4-cff4-49dc-9fda-f879732c9034', 'volume_size': 1} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5f4415-1d96-442f-97b2-d2a7e645223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c92d770a5b4c5abf20e19a833dd2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:52Z,use_quota=True,user_id='9c292f83cbb6473491210d091dc9aae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825f6d9e-8e06-49e2-85c7-3a4002cb8b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825f6d9e-8e06-49e2-85c7-3a4002cb8b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b58c48-0549-49fa-a187-725271081748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.image.glance [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Creating Keystone auth plugin from conf {{(pid=87042) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b58c48-0549-49fa-a187-725271081748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b', 'volume_name': 'volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b', 'volume_size': 1, 'image_id': 'cf91a511-4318-4767-8c02-681bc0298455', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf91a511-4318-4767-8c02-681bc0298455', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a3a4e04946b060e45ecb6efb8f6aa40f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1c92d770a5b4c5abf20e19a833dd2dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '74ea55648545ab28efb44081d157d0f9e778122fc17474a4a87a8071b8b5748aa3483e5c48fbbba9d49cb8a08b7c8b095c05676aa1c8736d919aeec8d430db87', 'id': 'cf91a511-4318-4767-8c02-681bc0298455', 'created_at': datetime.datetime(2026, 7, 9, 13, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf91a511-4318-4767-8c02-681bc0298455/file', 'properties': {}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d1a22c-8b51-4501-a871-0170b067ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d1a22c-8b51-4501-a871-0170b067ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e9c926-c7b2-47c0-a813-735d0b4f9672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:52 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Volume 3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b', 'volume_size': 1, 'image_id': 'cf91a511-4318-4767-8c02-681bc0298455', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf91a511-4318-4767-8c02-681bc0298455', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a3a4e04946b060e45ecb6efb8f6aa40f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1c92d770a5b4c5abf20e19a833dd2dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '74ea55648545ab28efb44081d157d0f9e778122fc17474a4a87a8071b8b5748aa3483e5c48fbbba9d49cb8a08b7c8b095c05676aa1c8736d919aeec8d430db87', 'id': 'cf91a511-4318-4767-8c02-681bc0298455', 'created_at': datetime.datetime(2026, 7, 9, 13, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf91a511-4318-4767-8c02-681bc0298455/file', 'properties': {}}, 'image_service': } Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Trying to clone 3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b from image cf91a511-4318-4767-8c02-681bc0298455 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf91a511-4318-4767-8c02-681bc0298455', 'metadata': {}}]). {{(pid=87042) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:25:52 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d1813de5-9705-42b9-9cf6-3b966b6b619e" returned: 0 in 0.777s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-d1813de5-9705-42b9-9cf6-3b966b6b619e" released by "delete_volume" :: held 2.185s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created reservations ['410fbffc-1e41-42f7-86b8-5c7a234acdbd', '1f65dbf3-0895-492a-a5cc-e90e624045b6', '172163b7-05f0-40cd-88be-065273ea3aba', 'e267d8e8-d5cb-4f09-9639-25b26003d615'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:25:53 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Image download 0.00 MB at 0.00 MB/s Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7150ef9e-b9a5-4801-9070-bb14ce12e6fc]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:53 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:53 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:53 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5" returned: 0 in 1.022s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:53 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD Jul 09 15:25:53 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:53 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 Jul 09 15:25:53 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:53 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48 1073741824" returned: 0 in 1.164s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:53 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48 Jul 09 15:25:53 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:53 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.730s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:53 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Deleted volume successfully. Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d2d778a3-27ab-4f0c-8f3d-4ed938fb5c92 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-d1813de5-9705-42b9-9cf6-3b966b6b619e-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:53 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:54 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD Jul 09 15:25:54 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-423e8f10-008f-4a7e-8df6-9d0ded310f5f-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-423e8f10-008f-4a7e-8df6-9d0ded310f5f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:54 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48" returned: 0 in 0.729s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:54 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.138s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672473353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40faa9e-c2ba-49a4-a90b-e23a73371051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:51Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Creating volume b40faa9e-c2ba-49a4-a90b-e23a73371051 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:54 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5" returned: 1 in 0.940s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:54 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051 1073741824 Jul 09 15:25:54 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c909be3c-a9b0-4cf1-8162-2b9cfdc95f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc62b28-2880-4550-8da1-338d56abbb48', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eed5fc0-6497-444d-b4a9-4a36ceddba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:54 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5 Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "cinder-quobyte-423e8f10-008f-4a7e-8df6-9d0ded310f5f" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:54 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:54 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume volume-6dc62b28-2880-4550-8da1-338d56abbb48 (6dc62b28-2880-4550-8da1-338d56abbb48): created successfully Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eed5fc0-6497-444d-b4a9-4a36ceddba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (8d8d16f8-8e81-4be7-8327-3a9de18a4343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-423e8f10-008f-4a7e-8df6-9d0ded310f5f" acquired by "delete_volume" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:54 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ff1ffe8d-ecc6-4d69-b09b-b7915bd29d42 tempest-CreateVolumesFromSnapshotTest-942461040 None] Created volume successfully. Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb782230-26e1-4c14-8769-0bc63b87a7db]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:54 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f Jul 09 15:25:54 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:54 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD" returned: 1 in 0.900s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Temporary image cf91a511-4318-4767-8c02-681bc0298455 is fetched for user 9c292f83cbb6473491210d091dc9aae0. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d020d2-8c74-4d1b-9812-f81bbaa94775]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:54 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0738284f-7043-4cbb-8ce2-11bf292901f5" returned: 0 in 0.742s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Lock "cinder-quobyte-0738284f-7043-4cbb-8ce2-11bf292901f5" released by "delete_volume" :: held 2.816s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Created reservations ['0251e24c-a145-4260-9503-e570fe68c252', '65265023-a0f7-4554-b837-7b887f65db57', 'acc07f1e-cf09-4c18-bcf0-d4736324a179', 'e6990e82-fef7-444d-990e-1966b146f245'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:55 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD Jul 09 15:25:55 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:55 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:55 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:55 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051 1073741824" returned: 0 in 1.002s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:55 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051 Jul 09 15:25:55 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:55 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f" returned: 0 in 0.976s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:55 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f Jul 09 15:25:55 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:55 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD" returned: 0 in 1.030s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:56 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.859s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:56 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Deleted volume successfully. Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-11476ff8-3d94-41eb-9507-bb3a81abb900 tempest-VolumeAndVolumeTypeFromImageTest-518109766 None] Lock "cinder-0738284f-7043-4cbb-8ce2-11bf292901f5-delete_volume" released by "delete_volume" :: held 3.974s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:56 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051" returned: 0 in 0.796s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.444s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101784203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2591953e-0726-4f6e-9680-5e1aa9f6a88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:51Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Creating volume 2591953e-0726-4f6e-9680-5e1aa9f6a88a {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:56 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:56 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a 1073741824 Jul 09 15:25:56 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD Jul 09 15:25:56 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:56 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160316b9-9f00-4572-9b9f-07134969056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40faa9e-c2ba-49a4-a90b-e23a73371051', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36763e1-1c07-4d87-82c4-1e0d14b6cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:56 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume volume-b40faa9e-c2ba-49a4-a90b-e23a73371051 (b40faa9e-c2ba-49a4-a90b-e23a73371051): created successfully Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36763e1-1c07-4d87-82c4-1e0d14b6cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (89901b81-a5dc-4306-8100-bad6f6543149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:56 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-41237975-f60e-4d14-89c5-127217b44504 tempest-CreateVolumesFromSnapshotTest-942461040 None] Created volume successfully. Jul 09 15:25:56 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-423e8f10-008f-4a7e-8df6-9d0ded310f5f" returned: 0 in 0.960s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-quobyte-423e8f10-008f-4a7e-8df6-9d0ded310f5f" released by "delete_volume" :: held 2.016s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Created reservations ['8a054968-c40f-4b04-ae56-603eabd16472', 'c38115f7-0b20-4223-840a-af5d58b639f9', '17139f3f-4e4e-4900-915c-083f28254332', '6b4f4143-2fe4-4230-937a-ff0e6d6e5252'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:56 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:25:56 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:56 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD" returned: 1 in 0.931s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:25:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:57 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a 1073741824" returned: 0 in 1.012s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:57 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a Jul 09 15:25:57 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:57 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.722s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:57 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Deleted volume successfully. Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c21d44e3-265c-4436-959f-eb0324ef3430 tempest-CreateVolumesFromSourceVolumeTest-58178364 None] Lock "cinder-423e8f10-008f-4a7e-8df6-9d0ded310f5f-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:57 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a" returned: 0 in 0.750s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.343s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730046665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b425f4-cff4-49dc-9fda-f879732c9034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d803c592f7484e995f14da109702b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:52Z,use_quota=True,user_id='33ef8602a04b46e7a4de3bfd84fce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Creating volume 72b425f4-cff4-49dc-9fda-f879732c9034 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:57 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d65bae-0ad2-49e8-88ad-dbfeebdf8eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11ee6e7-300b-4711-ae60-fbaeee7c706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:57 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034 1073741824 Jul 09 15:25:57 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:58 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a (2591953e-0726-4f6e-9680-5e1aa9f6a88a): created successfully Jul 09 15:25:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11ee6e7-300b-4711-ae60-fbaeee7c706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:58 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (fd6a28a5-e514-46d5-ac63-d2f0ff06e45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:58 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2b3af0b2-cea9-4375-9cd1-bb708df97c44 tempest-CreateVolumesFromSnapshotTest-942461040 None] Created volume successfully. Jul 09 15:25:59 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034 1073741824" returned: 0 in 1.080s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:59 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034 Jul 09 15:25:59 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:59 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034" returned: 0 in 0.708s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.849s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c92d770a5b4c5abf20e19a833dd2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:25:52Z,use_quota=True,user_id='9c292f83cbb6473491210d091dc9aae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Creating volume 3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:25:59 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd04976-e339-4efa-be44-96e3f0bf823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b425f4-cff4-49dc-9fda-f879732c9034', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:59 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b 1073741824 Jul 09 15:25:59 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f97160-12c3-4b70-b101-1516c6e0d276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:25:59 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Volume volume-72b425f4-cff4-49dc-9fda-f879732c9034 (72b425f4-cff4-49dc-9fda-f879732c9034): created successfully Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f97160-12c3-4b70-b101-1516c6e0d276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:25:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Flow 'volume_create_manager' (82d26d48-9eef-4faa-9ef1-eac39a0e823f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:25:59 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-29f82401-9cf9-469d-a95b-94fd7238cfbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Created volume successfully. Jul 09 15:26:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-72b425f4-cff4-49dc-9fda-f879732c9034-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-72b425f4-cff4-49dc-9fda-f879732c9034-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-quobyte-72b425f4-cff4-49dc-9fda-f879732c9034" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-72b425f4-cff4-49dc-9fda-f879732c9034" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:00 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c5cca2-6e8c-4dd5-8e7a-0558b1e59695]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:00 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034 Jul 09 15:26:00 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:01 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b 1073741824" returned: 0 in 1.240s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Flow 'volume_create_manager' (2622da63-6bd4-43a9-8c77-5acd7c6e4338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a814a5-7785-41dd-83b5-bfe788fdac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a814a5-7785-41dd-83b5-bfe788fdac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-451113466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36fb136-81bc-441e-bf55-2a2b84e72686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95405a21496f42a18d413eadacaec1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:01Z,use_quota=True,user_id='e0656e047fb140e0a052b2f49c49adf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6c7efe-985a-43fc-85bb-72c2c6bce65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6c7efe-985a-43fc-85bb-72c2c6bce65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d732a33-351a-4945-aecd-00dc7b66430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d732a33-351a-4945-aecd-00dc7b66430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36fb136-81bc-441e-bf55-2a2b84e72686', 'volume_name': 'volume-c36fb136-81bc-441e-bf55-2a2b84e72686', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a26025-9ff4-4ce5-98b6-c804d735f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a26025-9ff4-4ce5-98b6-c804d735f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16780b57-6345-461d-bc2e-60e3b61ecc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:01 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Volume c36fb136-81bc-441e-bf55-2a2b84e72686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36fb136-81bc-441e-bf55-2a2b84e72686', 'volume_size': 1} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:01 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b Jul 09 15:26:01 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:01 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034" returned: 0 in 0.994s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:01 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034 Jul 09 15:26:01 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:01 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b" returned: 0 in 0.695s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-451113466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36fb136-81bc-441e-bf55-2a2b84e72686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95405a21496f42a18d413eadacaec1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:01Z,use_quota=True,user_id='e0656e047fb140e0a052b2f49c49adf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Creating volume c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:01 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:01 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-72b425f4-cff4-49dc-9fda-f879732c9034" returned: 0 in 0.681s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:01 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 1073741824 Jul 09 15:26:01 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-72b425f4-cff4-49dc-9fda-f879732c9034" released by "delete_volume" :: held 1.736s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Attempting download of cf91a511-4318-4767-8c02-681bc0298455 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf91a511-4318-4767-8c02-681bc0298455', 'metadata': {}}])) to volume 3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:26:01 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Created reservations ['b8902da4-a2d7-45ac-a452-45b8cfcb8734', 'cfeb6490-546f-42d7-805f-81fa02425399', '98f3f3f6-7eb4-4307-82d8-e97d8926a170', 'b85dbdd1-c876-4ffa-a7ee-cd75b3e51af2'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[107a38fb-54b6-4973-980f-ea8d99ba1d5d]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf91a511-4318-4767-8c02-681bc0298455_4iucauc8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:02 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:02 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:02 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf91a511-4318-4767-8c02-681bc0298455_4iucauc8 Jul 09 15:26:02 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-2591953e-0726-4f6e-9680-5e1aa9f6a88a-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-2591953e-0726-4f6e-9680-5e1aa9f6a88a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-quobyte-2591953e-0726-4f6e-9680-5e1aa9f6a88a" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-2591953e-0726-4f6e-9680-5e1aa9f6a88a" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c4e40b-909e-44c3-88b2-616d165b83b0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:02 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a Jul 09 15:26:02 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:02 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf91a511-4318-4767-8c02-681bc0298455_4iucauc8" returned: 0 in 0.848s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf91a511-4318-4767-8c02-681bc0298455_4iucauc8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:02 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf91a511-4318-4767-8c02-681bc0298455_4iucauc8 Jul 09 15:26:03 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:03 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 1073741824" returned: 0 in 1.156s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:03 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.916s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:03 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Deleted volume successfully. Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d7279708-c350-4ab5-bef5-a3687f489826 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-72b425f4-cff4-49dc-9fda-f879732c9034-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:03 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 Jul 09 15:26:03 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:03 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a" returned: 0 in 1.086s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:03 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a Jul 09 15:26:03 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:03 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf91a511-4318-4767-8c02-681bc0298455_4iucauc8" returned: 1 in 0.895s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf91a511-4318-4767-8c02-681bc0298455_4iucauc8' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d1bb4e-fc6c-45b4-8f3d-ff4a9e57ad93]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:03 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686" returned: 0 in 0.718s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16780b57-6345-461d-bc2e-60e3b61ecc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36fb136-81bc-441e-bf55-2a2b84e72686', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84808ca-05c4-44a8-b2fb-f99fe9d15677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:03 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Volume volume-c36fb136-81bc-441e-bf55-2a2b84e72686 (c36fb136-81bc-441e-bf55-2a2b84e72686): created successfully Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84808ca-05c4-44a8-b2fb-f99fe9d15677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Flow 'volume_create_manager' (2622da63-6bd4-43a9-8c77-5acd7c6e4338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:03 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-84b103d7-b000-45c7-8ba9-0a4ae1fc8152 tempest-VolumeDependencyTests-1826772112 None] Created volume successfully. Jul 09 15:26:03 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD Jul 09 15:26:03 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:04 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2591953e-0726-4f6e-9680-5e1aa9f6a88a" returned: 0 in 0.834s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-2591953e-0726-4f6e-9680-5e1aa9f6a88a" released by "delete_volume" :: held 1.993s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Created reservations ['9708d2b1-bb5a-4a4b-99e9-7c5a03d351aa', '353fee51-14be-452e-81fc-83b162480456', '7df912b3-58b3-4a7f-9cb4-96593f8a4ffa', 'd8a78b3e-ff70-4e90-95a3-0e7f4d5c45e1'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Creating offline snapshot d6b34654-aed6-4508-b50a-d7fcc5b2e5da of volume c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccf4afd-2a82-4119-8cbe-684ba714a901]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:04 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:04 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:04 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD" returned: 0 in 0.932s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:04 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 Jul 09 15:26:04 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:04 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD Jul 09 15:26:04 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:04 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:04 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:05 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.104s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-b40faa9e-c2ba-49a4-a90b-e23a73371051-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:05 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Deleted volume successfully. Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-b40faa9e-c2ba-49a4-a90b-e23a73371051-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-152ed511-5fb6-4b62-9812-10f96f591320 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-2591953e-0726-4f6e-9680-5e1aa9f6a88a-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-quobyte-b40faa9e-c2ba-49a4-a90b-e23a73371051" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-b40faa9e-c2ba-49a4-a90b-e23a73371051" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:05 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:05 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686" returned: 0 in 1.280s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a22225-65de-41ba-b107-ec113cb5779d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD" returned: 1 in 1.285s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:26:06 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] cf91a511-4318-4767-8c02-681bc0298455 was raw, converting to raw {{(pid=87042) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:26:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:06 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da 1G Jul 09 15:26:06 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:06 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b Jul 09 15:26:06 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:06 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051 Jul 09 15:26:06 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:06 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 1.233s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:06 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:06 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:26:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:26:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:26:07 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051" returned: 0 in 1.019s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:07 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051 Jul 09 15:26:07 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:07 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da 1G" returned: 0 in 1.071s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36fb136-81bc-441e-bf55-2a2b84e72686 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:07 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b" returned: 0 in 1.061s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf91a511-4318-4767-8c02-681bc0298455_24a3mxlfdevstack@QuobyteHD, size 0.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:26:07 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:07 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36fb136-81bc-441e-bf55-2a2b84e72686 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da Jul 09 15:26:07 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:07 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b 1G Jul 09 15:26:07 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:07 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b40faa9e-c2ba-49a4-a90b-e23a73371051" returned: 0 in 0.708s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-b40faa9e-c2ba-49a4-a90b-e23a73371051" released by "delete_volume" :: held 1.814s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Created reservations ['547f61e0-2375-43a1-9fd9-88b636af69b2', '77ec9594-f410-44ea-9b0b-52363a1f169f', '63224c78-c90e-4a2b-a1b6-312023d687e2', '9fd4b03c-2f9e-476e-a7ba-ca3eece90cb5'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:07 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36fb136-81bc-441e-bf55-2a2b84e72686 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da" returned: 0 in 0.861s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:07 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da is being set with open permissions: ugo+rw Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:07 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b 1G" returned: 0 in 0.854s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:07 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:07 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ece8032-3d27-4285-8e20-50f730351678]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:07 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:08 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:08 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b Jul 09 15:26:08 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-6dc62b28-2880-4550-8da1-338d56abbb48-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-6dc62b28-2880-4550-8da1-338d56abbb48-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-quobyte-6dc62b28-2880-4550-8da1-338d56abbb48" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-6dc62b28-2880-4550-8da1-338d56abbb48" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a75e947-da17-484a-88c1-774b85fa09cb]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (ba63c6d5-3d70-4824-b082-1a48d2d4b394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3575cf9-1f76-4da2-aa0e-7d43fd2f948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3575cf9-1f76-4da2-aa0e-7d43fd2f948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593381613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897347e7-4a41-42be-b68f-076143290a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:08Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159fe6da-add0-4bde-9c84-7e3889762bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159fe6da-add0-4bde-9c84-7e3889762bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdce108d-58e5-4da4-bf32-9647d861d17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdce108d-58e5-4da4-bf32-9647d861d17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897347e7-4a41-42be-b68f-076143290a36', 'volume_name': 'volume-897347e7-4a41-42be-b68f-076143290a36', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d89a950-ad90-4bb9-86d8-8d102d1a51ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d89a950-ad90-4bb9-86d8-8d102d1a51ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60176ee-5e12-4a88-813c-03049cf13ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Volume 897347e7-4a41-42be-b68f-076143290a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897347e7-4a41-42be-b68f-076143290a36', 'volume_size': 1} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:08 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48 Jul 09 15:26:08 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:08 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da" returned: 0 in 0.931s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:08 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.info Jul 09 15:26:08 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:08 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.998s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:08 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Deleted volume successfully. Jul 09 15:26:08 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-77476e8c-6026-47b7-a0de-7b7da0b06bbf tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-b40faa9e-c2ba-49a4-a90b-e23a73371051-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:09 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b" returned: 0 in 1.019s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:09 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b Jul 09 15:26:09 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:09 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48" returned: 0 in 0.871s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:09 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48 Jul 09 15:26:09 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:09 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.info" returned: 0 in 0.708s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:09 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.info is being set with open permissions: ugo+rw Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:09 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.info Jul 09 15:26:09 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:09 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b" returned: 1 in 0.830s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Downloaded image cf91a511-4318-4767-8c02-681bc0298455 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf91a511-4318-4767-8c02-681bc0298455', 'metadata': {}}])) to volume 3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b successfully. {{(pid=87042) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Temporary image cf91a511-4318-4767-8c02-681bc0298455 for user 9c292f83cbb6473491210d091dc9aae0 is deleted. {{(pid=87042) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG cinder.volume.volume_utils [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Marking volume 3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b as bootable. {{(pid=87042) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Copying metadata from image cf91a511-4318-4767-8c02-681bc0298455 to 3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b. {{(pid=87042) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Creating volume glance metadata for volume 3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b backed by image cf91a511-4318-4767-8c02-681bc0298455 with: {'image_id': 'cf91a511-4318-4767-8c02-681bc0298455', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a3a4e04946b060e45ecb6efb8f6aa40f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87042) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e9c926-c7b2-47c0-a813-735d0b4f9672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b', 'volume_size': 1, 'image_id': 'cf91a511-4318-4767-8c02-681bc0298455', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf91a511-4318-4767-8c02-681bc0298455', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a3a4e04946b060e45ecb6efb8f6aa40f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1c92d770a5b4c5abf20e19a833dd2dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '74ea55648545ab28efb44081d157d0f9e778122fc17474a4a87a8071b8b5748aa3483e5c48fbbba9d49cb8a08b7c8b095c05676aa1c8736d919aeec8d430db87', 'id': 'cf91a511-4318-4767-8c02-681bc0298455', 'created_at': datetime.datetime(2026, 7, 9, 13, 25, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 25, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf91a511-4318-4767-8c02-681bc0298455/file', 'properties': {}}, 'image_service': }' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418c46cd-5787-4d92-b9df-1e2406478e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:09 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Volume volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b (3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b): created successfully Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418c46cd-5787-4d92-b9df-1e2406478e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Flow 'volume_create_manager' (a14b7e48-754f-47a6-9ab3-95454f71a8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-0c4f3293-393a-4437-a3a0-4f0e8403d1f4 tempest-VolumeImageDependencyTests-1953493109 None] Created volume successfully. Jul 09 15:26:09 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6dc62b28-2880-4550-8da1-338d56abbb48" returned: 0 in 0.720s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-6dc62b28-2880-4550-8da1-338d56abbb48" released by "delete_volume" :: held 1.663s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Created reservations ['95a1bea1-a7d4-4741-85c5-e39e619c3cb0', '29cf51e2-87db-4758-a2de-8578aa67ad33', '84ac19b7-03d8-4be9-958f-bc0517f3d402', '97a105d9-36f2-42a4-bc44-30bc614464fd'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:10 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:10 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:10 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.info" returned: 0 in 0.666s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.648s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.768s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593381613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897347e7-4a41-42be-b68f-076143290a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:08Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Creating volume 897347e7-4a41-42be-b68f-076143290a36 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:10 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:10 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 1073741824 Jul 09 15:26:10 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:10 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2665c6f9-8a89-4466-b237-5e57aa0fa650 tempest-VolumeDependencyTests-1826772112 None] Create snapshot completed successfully Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-62ffdb86-fa4f-4c75-af16-bd2b973002d4-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-62ffdb86-fa4f-4c75-af16-bd2b973002d4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-quobyte-62ffdb86-fa4f-4c75-af16-bd2b973002d4" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-62ffdb86-fa4f-4c75-af16-bd2b973002d4" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a427e041-ddb7-4c33-8a95-ce1184e96a47]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:10 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4 Jul 09 15:26:10 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:10 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.696s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:10 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Deleted volume successfully. Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=194,cinder:SELECT=159,cinder:INSERT=51,cinder:DELETE=22 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:26:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-629c6edb-ee82-4f6d-a0d2-483baa505cf7 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-6dc62b28-2880-4550-8da1-338d56abbb48-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Acquiring lock "cinder-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Lock "cinder-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Acquiring lock "cinder-quobyte-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Lock "cinder-quobyte-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c792dda-122e-4a28-a92e-cea2d45f90cb]: (4, 'raw') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:11 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 1073741824" returned: 0 in 1.093s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:11 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b Jul 09 15:26:11 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=125,cinder:UPDATE=197,cinder:DELETE=16,cinder:INSERT=54 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:11 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 Jul 09 15:26:11 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:11 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4" returned: 0 in 1.073s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:11 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4 Jul 09 15:26:11 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Flow 'volume_create_manager' (ee9a3d5e-3d21-4eb6-bc21-703203a69440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60e46d5-e3ca-4b41-84a8-9023f7017f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60e46d5-e3ca-4b41-84a8-9023f7017f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-701244338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a8a703-345d-4c3d-8eb3-bf35d019eb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95405a21496f42a18d413eadacaec1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d6b34654-aed6-4508-b50a-d7fcc5b2e5da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:12Z,use_quota=True,user_id='e0656e047fb140e0a052b2f49c49adf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b494069-72ee-4260-94f8-97d99684b803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b494069-72ee-4260-94f8-97d99684b803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8a3135-e823-48fc-8506-d2e227aac7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8a3135-e823-48fc-8506-d2e227aac7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd6a8a703-345d-4c3d-8eb3-bf35d019eb56', 'volume_name': 'volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56', 'volume_size': 1, 'snapshot_id': 'd6b34654-aed6-4508-b50a-d7fcc5b2e5da'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915491f3-dfd4-473e-8651-22109556cf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915491f3-dfd4-473e-8651-22109556cf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1288ff6-81e4-41ab-9c91-0532a1083352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:11 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Volume d6a8a703-345d-4c3d-8eb3-bf35d019eb56: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56', 'volume_size': 1, 'snapshot_id': 'd6b34654-aed6-4508-b50a-d7fcc5b2e5da'} Jul 09 15:26:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:12 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b" returned: 0 in 0.945s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:12 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36" returned: 0 in 0.750s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.384s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "cinder-quobyte-d6b34654-aed6-4508-b50a-d7fcc5b2e5da-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" by "_create_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60176ee-5e12-4a88-813c-03049cf13ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897347e7-4a41-42be-b68f-076143290a36', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62814534-b32f-4226-a366-f818d010c5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-d6b34654-aed6-4508-b50a-d7fcc5b2e5da-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Creating volume d6a8a703-345d-4c3d-8eb3-bf35d019eb56 from snapshot d6b34654-aed6-4508-b50a-d7fcc5b2e5da {{(pid=87042) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "cinder-quobyte-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:12 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Volume volume-897347e7-4a41-42be-b68f-076143290a36 (897347e7-4a41-42be-b68f-076143290a36): created successfully Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62814534-b32f-4226-a366-f818d010c5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (ba63c6d5-3d70-4824-b082-1a48d2d4b394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] snapshot: d6b34654-aed6-4508-b50a-d7fcc5b2e5da, volume: d6a8a703-345d-4c3d-8eb3-bf35d019eb56, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:26:12 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b Jul 09 15:26:12 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:12 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-135b2f06-bc4d-4264-848c-e266720d4e4f tempest-ProjectMemberTests-1490863771 None] Created volume successfully. Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a4054b-592a-4448-8d4e-63d868c13b07]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:12 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-62ffdb86-fa4f-4c75-af16-bd2b973002d4" returned: 0 in 0.733s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-62ffdb86-fa4f-4c75-af16-bd2b973002d4" released by "delete_volume" :: held 1.875s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Created reservations ['635fe841-ed3e-4ad8-b0b1-fab88cbd664d', '30804e04-33e5-404c-a96f-2691cf456874', 'ac5d681c-f049-4c8c-8dd6-bc8d48df1775', '9152bd22-d04f-471d-b255-b36b63740c6a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:12 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da Jul 09 15:26:12 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:12 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:12 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-0a24ac17-225c-4126-be3f-c74177d01692-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-0a24ac17-225c-4126-be3f-c74177d01692-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-quobyte-18c91562-afd7-4a30-9f6b-0babd9aca066" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-18c91562-afd7-4a30-9f6b-0babd9aca066" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-quobyte-0a24ac17-225c-4126-be3f-c74177d01692" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-0a24ac17-225c-4126-be3f-c74177d01692" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Deleting offline snapshot 0a24ac17-225c-4126-be3f-c74177d01692 of volume 18c91562-afd7-4a30-9f6b-0babd9aca066 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:26:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] snapshot_file for this snap is: volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[75229832-02cc-4733-8ebd-98bcec70f564]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:13 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 Jul 09 15:26:13 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:13 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b" returned: 1 in 1.116s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b' failed. Not Retrying. {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:13 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b Jul 09 15:26:13 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:13 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da" returned: 0 in 1.021s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c36fb136-81bc-441e-bf55-2a2b84e72686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:26:13 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.837s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a37a678-d168-409e-82e6-a22d2c4cf34a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:13 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Deleted volume successfully. Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-3681d7b2-c557-485c-9c4a-2282ec0bae4d tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-62ffdb86-fa4f-4c75-af16-bd2b973002d4-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:13 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 Jul 09 15:26:13 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:13 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692" returned: 0 in 0.900s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18c91562-afd7-4a30-9f6b-0babd9aca066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6211d98-f955-4101-bc48-d0e103e8d249]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:14 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b" returned: 0 in 0.702s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Lock "cinder-quobyte-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b" released by "delete_volume" :: held 2.836s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:14 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 Jul 09 15:26:14 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Created reservations ['7e0dc731-3b0a-4209-b7fa-decad11e660b', '25fa0d14-5620-40e1-9072-95f0f23db037', 'be7e87b3-7492-4c85-a694-6dc9e8f78420', '8458a414-52fe-46f8-b4e5-ee74d14909c7'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:14 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:14 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:14 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686" returned: 0 in 0.830s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:14 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 Jul 09 15:26:14 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:14 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.729s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Deleted volume successfully. Jul 09 15:26:14 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066" returned: 0 in 0.989s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a460cf1f-02b5-4982-b3e1-c50a8c84726e tempest-VolumeImageDependencyTests-1953493109 None] Lock "cinder-3165b33a-603d-4e1b-bacf-b4e9f8ac4a7b-delete_volume" released by "delete_volume" :: held 3.838s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:14 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 Jul 09 15:26:14 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:16 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692" returned: 0 in 1.175s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:16 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692 Jul 09 15:26:16 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:17 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066.0a24ac17-225c-4126-be3f-c74177d01692" returned: 0 in 1.224s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-0a24ac17-225c-4126-be3f-c74177d01692" released by "_delete_snapshot" :: held 4.444s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-18c91562-afd7-4a30-9f6b-0babd9aca066" released by "delete_snapshot" :: held 4.483s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:17 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Created reservations ['895d3610-ae80-400b-b22f-44e67395c0fa', '65f80636-54b3-4d5c-85a5-372825572f17', '2df0404d-5ca8-410d-b3e2-0dd5dfa3818c', '25662bb2-cb54-43c2-95b3-af150bfc2b07'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:17 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Delete snapshot completed successfully. Jul 09 15:26:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9aef97df-f2c3-485d-b742-c77719062219 tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-0a24ac17-225c-4126-be3f-c74177d01692-delete_snapshot" released by "delete_snapshot" :: held 4.794s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-18c91562-afd7-4a30-9f6b-0babd9aca066-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-18c91562-afd7-4a30-9f6b-0babd9aca066-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "cinder-quobyte-18c91562-afd7-4a30-9f6b-0babd9aca066" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-18c91562-afd7-4a30-9f6b-0babd9aca066" acquired by "delete_volume" :: waited 0.042s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:18 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25c94e6-f68a-4de6-bf89-13725bb57805]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:19 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 Jul 09 15:26:19 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:20 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066" returned: 0 in 1.478s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:20 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066 Jul 09 15:26:20 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:20 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" returned: 0 in 6.042s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:20 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c9efe5-0b2c-43bf-985f-7e0fa59fcbac]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:20 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 Jul 09 15:26:20 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:20 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18c91562-afd7-4a30-9f6b-0babd9aca066" returned: 0 in 0.712s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-quobyte-18c91562-afd7-4a30-9f6b-0babd9aca066" released by "delete_volume" :: held 2.317s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Created reservations ['4dc2fbf4-164d-490e-9a70-73301052b371', '82ac3191-576f-421d-8fb7-e847ae0375d3', 'b9852933-0af8-49a6-95cf-edf3a6b3ae75', '5247073f-936f-4a58-8c51-92b337e3425e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:21 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:21 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:21 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686" returned: 0 in 0.987s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:26:21 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Converted 1024.00 MB image at 169.42 MB/s Jul 09 15:26:21 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 is being set with open permissions: ugo+rw Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:21 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 Jul 09 15:26:21 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Flow 'volume_create_manager' (c9f59599-3685-42cd-97ff-bd42fcc290e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef1d8ab-bf80-4e31-a51f-d10f961fede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef1d8ab-bf80-4e31-a51f-d10f961fede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-730287285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cb029b96ac45e9964932ac8926fbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:21Z,use_quota=True,user_id='4d8c682d7a8e4768b08b6024793b3e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d3653e-cd91-4f7e-983f-24633b6ac79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d3653e-cd91-4f7e-983f-24633b6ac79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d8272f-9729-45aa-88d4-af557b5368a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d8272f-9729-45aa-88d4-af557b5368a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5', 'volume_name': 'volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbb9746-cd09-40bc-ba39-c6a0551cf0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbb9746-cd09-40bc-ba39-c6a0551cf0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e3a418-afbb-49e7-ba5a-cb41b89bed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Volume c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5', 'volume_size': 1} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:21 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.719s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:21 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Deleted volume successfully. Jul 09 15:26:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-eb8930cc-e20e-4b25-9137-76e22a15ddfd tempest-CreateVolumesFromSnapshotTest-942461040 None] Lock "cinder-18c91562-afd7-4a30-9f6b-0babd9aca066-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:22 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" returned: 0 in 0.684s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" released by "_copy_volume_from_snapshot" :: held 9.731s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-d6b34654-aed6-4508-b50a-d7fcc5b2e5da-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" released by "_create_volume_from_snapshot" :: held 9.792s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.837s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.043s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Creating offline snapshot 24900002-5c32-425f-86c2-3d9517a69ad8 of volume 897347e7-4a41-42be-b68f-076143290a36 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1288ff6-81e4-41ab-9c91-0532a1083352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56', 'volume_size': 1, 'snapshot_id': 'd6b34654-aed6-4508-b50a-d7fcc5b2e5da'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f167a7b-3d9a-47b4-bc30-971a46788cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e6ea1a-fcff-43bf-a354-817f9a13a02e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Volume volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 (d6a8a703-345d-4c3d-8eb3-bf35d019eb56): created successfully Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f167a7b-3d9a-47b4-bc30-971a46788cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Flow 'volume_create_manager' (ee9a3d5e-3d21-4eb6-bc21-703203a69440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-72d7fe73-7f98-4dc3-98ac-4763e9570d9e tempest-VolumeDependencyTests-1826772112 None] Created volume successfully. Jul 09 15:26:22 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 Jul 09 15:26:22 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "cinder-d6b34654-aed6-4508-b50a-d7fcc5b2e5da-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-d6b34654-aed6-4508-b50a-d7fcc5b2e5da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "cinder-quobyte-c36fb136-81bc-441e-bf55-2a2b84e72686" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-c36fb136-81bc-441e-bf55-2a2b84e72686" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "cinder-quobyte-d6b34654-aed6-4508-b50a-d7fcc5b2e5da" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-d6b34654-aed6-4508-b50a-d7fcc5b2e5da" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Deleting offline snapshot d6b34654-aed6-4508-b50a-d7fcc5b2e5da of volume c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] snapshot_file for this snap is: volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7da48c-f153-42e7-adc1-b2e1e8be8529]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:22 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36" returned: 0 in 0.828s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:22 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 1G Jul 09 15:26:22 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:22 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da Jul 09 15:26:22 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:23 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da" returned: 0 in 0.817s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c36fb136-81bc-441e-bf55-2a2b84e72686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:26:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b516e32-dbdb-4cb3-af5d-43d2e8bfe727]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:23 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 Jul 09 15:26:23 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:23 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 1G" returned: 0 in 0.923s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-897347e7-4a41-42be-b68f-076143290a36 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:23 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-897347e7-4a41-42be-b68f-076143290a36 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 Jul 09 15:26:23 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:24 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686" returned: 0 in 0.798s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:24 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da Jul 09 15:26:24 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:24 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-897347e7-4a41-42be-b68f-076143290a36 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8" returned: 0 in 0.792s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:24 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 is being set with open permissions: ugo+rw Jul 09 15:26:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:24 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 Jul 09 15:26:24 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:25 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8" returned: 0 in 0.671s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:25 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da" returned: 0 in 0.884s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:25 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.info Jul 09 15:26:25 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:25 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da Jul 09 15:26:25 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:26 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686.d6b34654-aed6-4508-b50a-d7fcc5b2e5da" returned: 0 in 0.641s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:26 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.info" returned: 0 in 0.699s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:26 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.info is being set with open permissions: ugo+rw Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-d6b34654-aed6-4508-b50a-d7fcc5b2e5da" released by "_delete_snapshot" :: held 3.256s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-c36fb136-81bc-441e-bf55-2a2b84e72686" released by "delete_snapshot" :: held 3.284s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:26 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.info Jul 09 15:26:26 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Created reservations ['9dd862d7-b1ba-430c-91b3-7ca35b61c307', 'f1b2b771-8a30-4fce-bbe5-0432637f59d9', 'cdec93ea-ee64-4139-9633-1c6f6dbf12fb', '06d66ce5-3c7f-4692-826a-352e513aaa63'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Delete snapshot completed successfully. Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-9e3b0c72-536e-406c-8aff-958f85a7ef7f tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-d6b34654-aed6-4508-b50a-d7fcc5b2e5da-delete_snapshot" released by "delete_snapshot" :: held 3.446s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:26 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.info" returned: 0 in 0.728s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.244s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-730287285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cb029b96ac45e9964932ac8926fbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:21Z,use_quota=True,user_id='4d8c682d7a8e4768b08b6024793b3e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Creating volume c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:26 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:26:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:26 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 1073741824 Jul 09 15:26:26 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8c50c178-7cab-40fe-8ec6-86be2d401e23 tempest-ProjectMemberTests-1490863771 None] Create snapshot completed successfully Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "cinder-c36fb136-81bc-441e-bf55-2a2b84e72686-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-c36fb136-81bc-441e-bf55-2a2b84e72686-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "cinder-quobyte-c36fb136-81bc-441e-bf55-2a2b84e72686" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-c36fb136-81bc-441e-bf55-2a2b84e72686" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c9a6d0-0cf8-41f7-98f3-594c941c0ec6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:27 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 Jul 09 15:26:27 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-24900002-5c32-425f-86c2-3d9517a69ad8-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:27 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 1073741824" returned: 0 in 1.079s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-24900002-5c32-425f-86c2-3d9517a69ad8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-897347e7-4a41-42be-b68f-076143290a36" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-897347e7-4a41-42be-b68f-076143290a36" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-24900002-5c32-425f-86c2-3d9517a69ad8" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-24900002-5c32-425f-86c2-3d9517a69ad8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Deleting offline snapshot 24900002-5c32-425f-86c2-3d9517a69ad8 of volume 897347e7-4a41-42be-b68f-076143290a36 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] snapshot_file for this snap is: volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e17295-183b-490d-871b-af6d4c783cf7]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:28 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 Jul 09 15:26:28 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:28 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686" returned: 0 in 0.934s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:28 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686 Jul 09 15:26:28 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 Jul 09 15:26:28 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:28 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:28 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5" returned: 0 in 0.796s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e3a418-afbb-49e7-ba5a-cb41b89bed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8864f810-f492-4ce5-874f-707077ad98d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:28 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Volume volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 (c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5): created successfully Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8864f810-f492-4ce5-874f-707077ad98d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Flow 'volume_create_manager' (c9f59599-3685-42cd-97ff-bd42fcc290e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:28 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7aace495-cdd6-4ad9-9fd5-46a41ddd6040 tempest-ProjectReaderTests-1222507944 None] Created volume successfully. Jul 09 15:26:28 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c36fb136-81bc-441e-bf55-2a2b84e72686" returned: 0 in 0.802s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-c36fb136-81bc-441e-bf55-2a2b84e72686" released by "delete_volume" :: held 1.821s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:28 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8" returned: 0 in 0.956s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-897347e7-4a41-42be-b68f-076143290a36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7126e023-1eb3-4ba3-993d-d7c297f2757b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Created reservations ['3f57131c-af04-4c9c-ab50-b586eecf2055', 'c2383369-665d-408e-95d0-a4236d9f564d', '52f22f3b-8826-4d6a-b44b-6130d0934e6a', '174a9b0e-590e-412e-91e9-fe03e163e6c3'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:29 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 Jul 09 15:26:29 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:29 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:29 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Acquiring lock "cinder-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "cinder-d6a8a703-345d-4c3d-8eb3-bf35d019eb56-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Lock "cinder-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-d6a8a703-345d-4c3d-8eb3-bf35d019eb56-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "cinder-quobyte-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Acquiring lock "cinder-quobyte-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Lock "cinder-quobyte-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5" acquired by "delete_volume" :: waited 0.029s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" acquired by "delete_volume" :: waited 0.060s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b55e2-fe04-4c1c-8e39-1db153a6fac9]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b337a36-988f-4b0a-a693-de778e737310]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:29 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 Jul 09 15:26:29 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:29 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 Jul 09 15:26:29 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:30 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.881s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:30 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:30 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Deleted volume successfully. Jul 09 15:26:30 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-707baf43-7eb8-469b-8b4d-389996c8aa48 tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-c36fb136-81bc-441e-bf55-2a2b84e72686-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:30 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36" returned: 0 in 1.200s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:30 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 Jul 09 15:26:30 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:30 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5" returned: 0 in 0.869s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:30 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5 Jul 09 15:26:30 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:30 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" returned: 0 in 1.058s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:30 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56 Jul 09 15:26:30 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:31 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8" returned: 0 in 0.872s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:31 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8 Jul 09 15:26:31 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:31 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5" returned: 0 in 0.747s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Lock "cinder-quobyte-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5" released by "delete_volume" :: held 1.679s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Created reservations ['72a5c95e-d733-43c9-9eda-5cbf9c0529b4', '639896ba-b072-4dc3-bbcc-394d5b06d971', '4692597f-19b8-4e25-8d81-9d00001f4f7c', 'c530f390-86d6-4d73-a09b-f0acb83e3bbc'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:31 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" returned: 0 in 0.696s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:31 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:31 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-quobyte-d6a8a703-345d-4c3d-8eb3-bf35d019eb56" released by "delete_volume" :: held 1.807s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Created reservations ['682c69c7-e532-4169-82a8-176fa4dfac82', '261fe81c-80f5-4a72-8430-51f554aeeee0', '6fe06175-2581-4e22-8192-7a90dd7365fa', '1fdbbbd9-7799-431d-b232-d0a99f88c81f'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:31 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:31 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:31 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36.24900002-5c32-425f-86c2-3d9517a69ad8" returned: 0 in 0.731s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-24900002-5c32-425f-86c2-3d9517a69ad8" released by "_delete_snapshot" :: held 3.922s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-897347e7-4a41-42be-b68f-076143290a36" released by "delete_snapshot" :: held 3.959s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Created reservations ['d9a53dd8-f37f-4691-95cb-6b5514148649', 'e785293b-e4f8-4a1a-ab9d-905bbbbb5b18', '6b170014-5c5b-46d3-bcc5-260fbe0a3ea5', '49875892-e8df-4b64-8214-feb388d4c0be'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Delete snapshot completed successfully. Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-66124328-1ca7-49bc-9a52-92d424a93c09 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-24900002-5c32-425f-86c2-3d9517a69ad8-delete_snapshot" released by "delete_snapshot" :: held 4.209s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:32 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.752s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Deleted volume successfully. Jul 09 15:26:32 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.939s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Deleted volume successfully. Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1179e02b-9974-4eed-b953-2565ae0a5378 tempest-ProjectReaderTests-1222507944 None] Lock "cinder-c04fa465-cea9-4b6a-bc53-8ec6ec0e0ec5-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c8293950-c99f-4a66-b018-35f69f226cdf tempest-VolumeDependencyTests-1826772112 None] Lock "cinder-d6a8a703-345d-4c3d-8eb3-bf35d019eb56-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-897347e7-4a41-42be-b68f-076143290a36-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Flow 'volume_create_manager' (a888f3b8-a03e-4d71-a9f7-e13cb49dd6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1861b92d-a38d-49f9-93cf-2ba9ef5e7033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Lock "cinder-897347e7-4a41-42be-b68f-076143290a36-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1861b92d-a38d-49f9-93cf-2ba9ef5e7033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561837747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18275d4a-b4dd-4b77-84f0-e09550d71820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cb029b96ac45e9964932ac8926fbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:32Z,use_quota=True,user_id='4d8c682d7a8e4768b08b6024793b3e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05225e89-1fca-43dd-8446-169088fa42f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05225e89-1fca-43dd-8446-169088fa42f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d8ad1d-0754-4d2e-aece-9b1f0433fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d8ad1d-0754-4d2e-aece-9b1f0433fc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18275d4a-b4dd-4b77-84f0-e09550d71820', 'volume_name': 'volume-18275d4a-b4dd-4b77-84f0-e09550d71820', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d0b55d-4d8a-4ead-b809-d428875c15f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d0b55d-4d8a-4ead-b809-d428875c15f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b448374d-6ba8-4407-bd0c-7639e30ebff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:32 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Volume 18275d4a-b4dd-4b77-84f0-e09550d71820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18275d4a-b4dd-4b77-84f0-e09550d71820', 'volume_size': 1} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561837747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18275d4a-b4dd-4b77-84f0-e09550d71820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61cb029b96ac45e9964932ac8926fbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:32Z,use_quota=True,user_id='4d8c682d7a8e4768b08b6024793b3e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Creating volume 18275d4a-b4dd-4b77-84f0-e09550d71820 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:32 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:32 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820 1073741824 Jul 09 15:26:32 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-897347e7-4a41-42be-b68f-076143290a36" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-897347e7-4a41-42be-b68f-076143290a36" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b074e091-4e92-4c54-a215-d942e83bbc66]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:32 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 Jul 09 15:26:32 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:33 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820 1073741824" returned: 0 in 1.049s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:33 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820 Jul 09 15:26:33 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:33 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36" returned: 0 in 0.993s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:33 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36 Jul 09 15:26:33 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:34 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820" returned: 0 in 0.676s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b448374d-6ba8-4407-bd0c-7639e30ebff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18275d4a-b4dd-4b77-84f0-e09550d71820', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cada37d2-4c8a-4653-92e2-6f7a6f30fdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:34 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Volume volume-18275d4a-b4dd-4b77-84f0-e09550d71820 (18275d4a-b4dd-4b77-84f0-e09550d71820): created successfully Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cada37d2-4c8a-4653-92e2-6f7a6f30fdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Flow 'volume_create_manager' (a888f3b8-a03e-4d71-a9f7-e13cb49dd6fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ab10da90-50a0-4707-986c-785bbd87cd10 tempest-ProjectReaderTests-1222507944 None] Created volume successfully. Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Acquiring lock "cinder-18275d4a-b4dd-4b77-84f0-e09550d71820-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:34 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-897347e7-4a41-42be-b68f-076143290a36" returned: 0 in 0.902s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Lock "cinder-18275d4a-b4dd-4b77-84f0-e09550d71820-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-897347e7-4a41-42be-b68f-076143290a36" released by "delete_volume" :: held 2.012s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Acquiring lock "cinder-quobyte-18275d4a-b4dd-4b77-84f0-e09550d71820" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Lock "cinder-quobyte-18275d4a-b4dd-4b77-84f0-e09550d71820" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d80eb09-c597-4475-93e6-4f1a9a4784b4]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Created reservations ['a73c4b21-53e0-4631-83d2-03179bd7bb3d', '480c7055-1792-40ae-9c7e-db7ffcdb4f75', '06aa9f95-a6c1-45aa-bdbf-a067e1e80b32', 'bdd608d8-1097-48be-9a59-5b8111fd6f18'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:34 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820 Jul 09 15:26:34 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:34 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:34 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:35 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820" returned: 0 in 0.897s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:35 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.802s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:35 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820 Jul 09 15:26:35 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Deleted volume successfully. Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Flow 'volume_create_manager' (428fc3dc-2c1d-4cb8-9372-9ce4393a8475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1baeab3f-595c-4655-b830-6d9c68e508f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-ba250108-883a-4d6c-acd9-1304f6dbaffe tempest-ProjectMemberTests-1490863771 None] Lock "cinder-897347e7-4a41-42be-b68f-076143290a36-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1baeab3f-595c-4655-b830-6d9c68e508f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36df5bec-ec8d-4167-b3ae-a12da9994ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a12a663db38469ebb52352fe613e854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:36Z,use_quota=True,user_id='d0cb3eee980947c5bcf38f720f4a5861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45590949-9502-4979-854c-13adecd9b2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45590949-9502-4979-854c-13adecd9b2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48405209-54d1-4b46-a0d6-570a9f8e2e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48405209-54d1-4b46-a0d6-570a9f8e2e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36df5bec-ec8d-4167-b3ae-a12da9994ee3', 'volume_name': 'volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beaf6e19-28c8-49bf-bf9e-f440a8d191cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beaf6e19-28c8-49bf-bf9e-f440a8d191cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ea778d-a2b3-4e02-8602-87f793470024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:35 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Volume 36df5bec-ec8d-4167-b3ae-a12da9994ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3', 'volume_size': 1} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36df5bec-ec8d-4167-b3ae-a12da9994ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a12a663db38469ebb52352fe613e854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:36Z,use_quota=True,user_id='d0cb3eee980947c5bcf38f720f4a5861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Creating volume 36df5bec-ec8d-4167-b3ae-a12da9994ee3 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:35 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:26:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:35 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3 1073741824 Jul 09 15:26:35 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (db71132b-2e5c-4da7-8e24-c069f6d1881b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2699897-8417-48d2-a23b-7431cbd1c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2699897-8417-48d2-a23b-7431cbd1c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-958016241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2faf0e64-d338-43d0-9b7d-63eaba4f307b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:36Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c91493-dfda-46f3-a613-29ac5a0821cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c91493-dfda-46f3-a613-29ac5a0821cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecd7932-b1af-466a-b5dc-c59784a8e839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:36 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecd7932-b1af-466a-b5dc-c59784a8e839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2faf0e64-d338-43d0-9b7d-63eaba4f307b', 'volume_name': 'volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63950c04-02cc-4676-9611-186fe27ab736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63950c04-02cc-4676-9611-186fe27ab736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5f6ade-f5ab-49c1-9fac-e447988ab70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:36 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Volume 2faf0e64-d338-43d0-9b7d-63eaba4f307b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b', 'volume_size': 1} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-18275d4a-b4dd-4b77-84f0-e09550d71820" returned: 0 in 0.830s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Lock "cinder-quobyte-18275d4a-b4dd-4b77-84f0-e09550d71820" released by "delete_volume" :: held 1.785s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Created reservations ['c76eade8-30c0-4a8b-8913-56344ab0c969', '30685dd5-3311-41b1-b794-4082fdaeb3d0', 'ec28c558-10fb-404d-8325-bfbf672e98bd', '85073102-4ca8-4007-8f03-e37da874d0f3'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:36 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:36 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:36 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3 1073741824" returned: 0 in 1.079s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:37 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3 Jul 09 15:26:37 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:37 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.767s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Deleted volume successfully. Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bc82d7fc-e895-4d1f-8fc2-6a2fae643c53 tempest-ProjectReaderTests-1222507944 None] Lock "cinder-18275d4a-b4dd-4b77-84f0-e09550d71820-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:37 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3" returned: 0 in 0.811s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.304s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-958016241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2faf0e64-d338-43d0-9b7d-63eaba4f307b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:36Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Creating volume 2faf0e64-d338-43d0-9b7d-63eaba4f307b {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:37 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:37 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b 1073741824 Jul 09 15:26:37 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ea778d-a2b3-4e02-8602-87f793470024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc39c3e2-6f76-4bd5-aff6-00d73b21b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:37 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Volume volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3 (36df5bec-ec8d-4167-b3ae-a12da9994ee3): created successfully Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc39c3e2-6f76-4bd5-aff6-00d73b21b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Flow 'volume_create_manager' (428fc3dc-2c1d-4cb8-9372-9ce4393a8475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8b13cbf0-b0b8-4496-85f1-35b93291f454 tempest-CinderUnicodeTest-1064977357 None] Created volume successfully. Jul 09 15:26:38 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b 1073741824" returned: 0 in 1.004s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:38 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b Jul 09 15:26:38 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:39 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Flow 'volume_create_manager' (5a60f5da-21d0-4eb2-8528-f5c150b3010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f03c10-a7bf-42ca-a7f0-fb69e71d0440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b" returned: 0 in 0.752s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f03c10-a7bf-42ca-a7f0-fb69e71d0440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1518962074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae23e73-4725-4126-8ca5-68680a23bb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a12a663db38469ebb52352fe613e854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:40Z,use_quota=True,user_id='d0cb3eee980947c5bcf38f720f4a5861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4a6769-6fca-49e3-89e0-4c0b5af5ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4a6769-6fca-49e3-89e0-4c0b5af5ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b27bcb7-f72f-41a5-a719-0c958f1b60e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b27bcb7-f72f-41a5-a719-0c958f1b60e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae23e73-4725-4126-8ca5-68680a23bb3f', 'volume_name': 'volume-0ae23e73-4725-4126-8ca5-68680a23bb3f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239cdd94-35ce-403e-9886-ef0ef4246e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239cdd94-35ce-403e-9886-ef0ef4246e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7986fa-1372-47d5-8d73-d75d47e6651e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:39 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Volume 0ae23e73-4725-4126-8ca5-68680a23bb3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae23e73-4725-4126-8ca5-68680a23bb3f', 'volume_size': 1} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1518962074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae23e73-4725-4126-8ca5-68680a23bb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a12a663db38469ebb52352fe613e854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:40Z,use_quota=True,user_id='d0cb3eee980947c5bcf38f720f4a5861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Creating volume 0ae23e73-4725-4126-8ca5-68680a23bb3f {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:39 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5f6ade-f5ab-49c1-9fac-e447988ab70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13328927-4424-4432-a77f-6943411b838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:39 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f 1073741824 Jul 09 15:26:39 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:39 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Volume volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b (2faf0e64-d338-43d0-9b7d-63eaba4f307b): created successfully Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13328927-4424-4432-a77f-6943411b838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (db71132b-2e5c-4da7-8e24-c069f6d1881b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:39 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e11be8c5-dc18-4804-84f9-aa0c3508c78d tempest-ProjectMemberTests-1490863771 None] Created volume successfully. Jul 09 15:26:40 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f 1073741824" returned: 0 in 0.832s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:40 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f Jul 09 15:26:40 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:41 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f" returned: 0 in 0.640s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.395s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Creating offline snapshot da645839-edff-4994-b75a-15986359cfd5 of volume 2faf0e64-d338-43d0-9b7d-63eaba4f307b {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7986fa-1372-47d5-8d73-d75d47e6651e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae23e73-4725-4126-8ca5-68680a23bb3f', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e171186-8218-4c62-b967-2f9f5c668281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f001d0-0175-44c0-9b68-cd267cddeec8]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:41 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Volume volume-0ae23e73-4725-4126-8ca5-68680a23bb3f (0ae23e73-4725-4126-8ca5-68680a23bb3f): created successfully Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e171186-8218-4c62-b967-2f9f5c668281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Flow 'volume_create_manager' (5a60f5da-21d0-4eb2-8528-f5c150b3010a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-988bb461-d90f-4ef1-b5cf-5631f9e40f71 tempest-CinderUnicodeTest-1064977357 None] Created volume successfully. Jul 09 15:26:41 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b Jul 09 15:26:41 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:42 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b" returned: 0 in 0.800s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:42 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 1G Jul 09 15:26:42 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:42 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 1G" returned: 0 in 0.818s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:42 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 Jul 09 15:26:42 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:43 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5" returned: 0 in 0.665s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:43 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 is being set with open permissions: ugo+rw Jul 09 15:26:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:43 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 Jul 09 15:26:43 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:44 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5" returned: 0 in 0.650s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:44 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.info Jul 09 15:26:44 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:44 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.info" returned: 0 in 0.678s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:44 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.info is being set with open permissions: ugo+rw Jul 09 15:26:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:44 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.info Jul 09 15:26:44 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:45 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.info" returned: 0 in 0.677s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.373s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.642s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Creating offline snapshot e877b92b-f652-4c0a-9850-688c084c1fcf of volume 0ae23e73-4725-4126-8ca5-68680a23bb3f {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:26:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f1779b9b-9770-46b8-94aa-ffdb3d1fd9c4 tempest-ProjectMemberTests-1490863771 None] Create snapshot completed successfully Jul 09 15:26:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b181b4-0ac1-4dcc-9131-fc880a2c8931]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:45 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f Jul 09 15:26:45 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-da645839-edff-4994-b75a-15986359cfd5-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-da645839-edff-4994-b75a-15986359cfd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-2faf0e64-d338-43d0-9b7d-63eaba4f307b" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-2faf0e64-d338-43d0-9b7d-63eaba4f307b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-da645839-edff-4994-b75a-15986359cfd5" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-da645839-edff-4994-b75a-15986359cfd5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Deleting offline snapshot da645839-edff-4994-b75a-15986359cfd5 of volume 2faf0e64-d338-43d0-9b7d-63eaba4f307b {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] snapshot_file for this snap is: volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb21898-427f-45a3-a48a-3df71b501c11]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:46 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 Jul 09 15:26:46 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:46 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f" returned: 0 in 0.832s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:46 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf 1G Jul 09 15:26:46 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:47 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5" returned: 0 in 0.850s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:26:47 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7ab977-b8a9-40f9-9fc2-1b778a43936f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:47 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b Jul 09 15:26:47 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:47 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf 1G" returned: 0 in 0.915s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ae23e73-4725-4126-8ca5-68680a23bb3f -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:47 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ae23e73-4725-4126-8ca5-68680a23bb3f -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf Jul 09 15:26:47 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:47 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b" returned: 0 in 0.822s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:47 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 Jul 09 15:26:47 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:48 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ae23e73-4725-4126-8ca5-68680a23bb3f -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf" returned: 0 in 0.761s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:48 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf is being set with open permissions: ugo+rw Jul 09 15:26:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:48 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf Jul 09 15:26:48 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:48 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5" returned: 0 in 0.803s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:48 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5 Jul 09 15:26:48 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:48 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf" returned: 0 in 0.685s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:48 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.info Jul 09 15:26:48 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:49 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b.da645839-edff-4994-b75a-15986359cfd5" returned: 0 in 0.715s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-da645839-edff-4994-b75a-15986359cfd5" released by "_delete_snapshot" :: held 3.312s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-2faf0e64-d338-43d0-9b7d-63eaba4f307b" released by "delete_snapshot" :: held 3.342s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:49 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.info" returned: 0 in 0.678s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:49 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.info is being set with open permissions: ugo+rw Jul 09 15:26:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:49 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Created reservations ['051e8c97-f72a-4baf-b2dc-654e7cf53ff9', 'd53dda99-6f78-4104-b45b-05b38585a681', 'ae7c16f5-4d9d-4874-af4d-fe4d55a80895', '08dd34d0-cbb8-4b73-879f-c901cff79f67'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:49 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.info Jul 09 15:26:49 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:49 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Delete snapshot completed successfully. Jul 09 15:26:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-5f2380f3-b44c-42e2-b0c0-65b456700a62 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-da645839-edff-4994-b75a-15986359cfd5-delete_snapshot" released by "delete_snapshot" :: held 3.580s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:50 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.info" returned: 0 in 0.678s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.669s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:50 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b9a525a5-576a-463a-8ea8-5f8c21b1123f tempest-CinderUnicodeTest-1064977357 None] Create snapshot completed successfully Jul 09 15:26:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-2faf0e64-d338-43d0-9b7d-63eaba4f307b-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-2faf0e64-d338-43d0-9b7d-63eaba4f307b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-2faf0e64-d338-43d0-9b7d-63eaba4f307b" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:50 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-2faf0e64-d338-43d0-9b7d-63eaba4f307b" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:50 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3139844-a93d-4a6d-a832-29f819bbf35c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:50 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b Jul 09 15:26:50 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:51 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b" returned: 0 in 0.797s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:51 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b Jul 09 15:26:51 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "cinder-e877b92b-f652-4c0a-9850-688c084c1fcf-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-e877b92b-f652-4c0a-9850-688c084c1fcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "cinder-quobyte-0ae23e73-4725-4126-8ca5-68680a23bb3f" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-quobyte-0ae23e73-4725-4126-8ca5-68680a23bb3f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "cinder-quobyte-e877b92b-f652-4c0a-9850-688c084c1fcf" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-quobyte-e877b92b-f652-4c0a-9850-688c084c1fcf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Deleting offline snapshot e877b92b-f652-4c0a-9850-688c084c1fcf of volume 0ae23e73-4725-4126-8ca5-68680a23bb3f {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] snapshot_file for this snap is: volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d56f1d-644e-434b-8d14-f5d9460116fb]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:51 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf Jul 09 15:26:51 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:52 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2faf0e64-d338-43d0-9b7d-63eaba4f307b" returned: 0 in 0.689s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-2faf0e64-d338-43d0-9b7d-63eaba4f307b" released by "delete_volume" :: held 1.558s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Created reservations ['30c25c45-48b5-4e87-999c-c077f9407b49', '06c33f9c-f51e-4ec2-8399-6f8ca9d99929', '1dbdee46-7a0a-4ee3-97f9-0b5c4946043c', 'd0658cd5-b66d-4dbf-8a53-4602d6b54064'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:52 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:52 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:52 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf" returned: 0 in 0.852s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ae23e73-4725-4126-8ca5-68680a23bb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca52ddac-a217-4fa9-91a2-5c8764ee45f2]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:52 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f Jul 09 15:26:52 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:52 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.799s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:53 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Deleted volume successfully. Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1bac2ce0-af08-4f45-82aa-fd3bd6420852 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-2faf0e64-d338-43d0-9b7d-63eaba4f307b-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (4c62b033-fcfd-449c-9c5f-127669ca8871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2cd898-2992-4eea-8a15-c9735ae8b15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2cd898-2992-4eea-8a15-c9735ae8b15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810732787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a7f2d4-1300-48a1-b49b-bc0f8901dd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:53Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003b76a0-f392-40ea-8b99-f41daded4262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003b76a0-f392-40ea-8b99-f41daded4262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0524052d-936d-472d-9244-a7773a3a939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0524052d-936d-472d-9244-a7773a3a939a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a7f2d4-1300-48a1-b49b-bc0f8901dd29', 'volume_name': 'volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cf0fc7-92d2-49da-ae3b-ae48eff1cb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cf0fc7-92d2-49da-ae3b-ae48eff1cb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068bbcf4-fd00-4fdc-90aa-e181a5e47c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:53 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Volume 37a7f2d4-1300-48a1-b49b-bc0f8901dd29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29', 'volume_size': 1} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810732787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a7f2d4-1300-48a1-b49b-bc0f8901dd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:53Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Creating volume 37a7f2d4-1300-48a1-b49b-bc0f8901dd29 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:53 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:53 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f" returned: 0 in 0.905s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:53 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 1073741824 Jul 09 15:26:53 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:53 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf Jul 09 15:26:53 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:54 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf" returned: 0 in 0.794s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:54 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf Jul 09 15:26:54 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:54 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 1073741824" returned: 0 in 0.945s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:54 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 Jul 09 15:26:54 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:54 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f.e877b92b-f652-4c0a-9850-688c084c1fcf" returned: 0 in 0.707s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-quobyte-e877b92b-f652-4c0a-9850-688c084c1fcf" released by "_delete_snapshot" :: held 3.417s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:54 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-quobyte-0ae23e73-4725-4126-8ca5-68680a23bb3f" released by "delete_snapshot" :: held 3.452s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:54 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Created reservations ['20a20e67-a079-48f3-b0a6-83907b6cdedf', '863a6d31-cba2-48ea-9434-fb43ad6481e1', 'bcf9000a-bdff-4daa-a0a3-8622c2a3b0aa', 'db006cc7-4d8c-486b-9253-53ce9a0c85b5'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Delete snapshot completed successfully. Jul 09 15:26:55 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d0c90daa-18de-46e3-98a6-66e139153293 tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-e877b92b-f652-4c0a-9850-688c084c1fcf-delete_snapshot" released by "delete_snapshot" :: held 3.615s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" returned: 0 in 0.738s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068bbcf4-fd00-4fdc-90aa-e181a5e47c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f263e11-6e0b-400e-86a6-aefd66cf1b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:55 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Volume volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 (37a7f2d4-1300-48a1-b49b-bc0f8901dd29): created successfully Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f263e11-6e0b-400e-86a6-aefd66cf1b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (4c62b033-fcfd-449c-9c5f-127669ca8871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:55 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-08adb8c9-f59a-4650-a6ef-c4fa5543b90c tempest-ProjectMemberTests-1490863771 None] Created volume successfully. Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Creating offline snapshot c22d5afd-9056-4d59-b471-84f285de16e6 of volume 37a7f2d4-1300-48a1-b49b-bc0f8901dd29 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ebeed1-1f94-4c9c-8987-73a4927d5834]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:55 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 Jul 09 15:26:55 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "cinder-0ae23e73-4725-4126-8ca5-68680a23bb3f-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-0ae23e73-4725-4126-8ca5-68680a23bb3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "cinder-quobyte-0ae23e73-4725-4126-8ca5-68680a23bb3f" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-quobyte-0ae23e73-4725-4126-8ca5-68680a23bb3f" acquired by "delete_volume" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53cd36a-c36d-4a55-b258-83865cf09f79]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:55 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f Jul 09 15:26:55 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:56 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" returned: 0 in 0.837s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:56 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 1G Jul 09 15:26:56 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:56 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f" returned: 0 in 0.837s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:56 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f Jul 09 15:26:56 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:57 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 1G" returned: 0 in 0.921s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:57 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 Jul 09 15:26:57 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Flow 'volume_create_manager' (fb4d705c-5c6b-4166-98ab-53f69a839612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:57 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cde856e-c332-415e-9999-51191da2147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-0ae23e73-4725-4126-8ca5-68680a23bb3f" returned: 0 in 0.704s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cde856e-c332-415e-9999-51191da2147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1083490002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ade58c-2ce7-4845-8888-cdb89e8444fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a036c1e27ef4011a65b57a729cf366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:57Z,use_quota=True,user_id='9de2f97be19d40989c0c6e1bf67b235d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226944c-90b9-4ece-bd8d-0a691d24f005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226944c-90b9-4ece-bd8d-0a691d24f005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c210706d-4cfb-40c8-9160-cb644e301e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c210706d-4cfb-40c8-9160-cb644e301e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ade58c-2ce7-4845-8888-cdb89e8444fe', 'volume_name': 'volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa1e9e4-5951-4914-b60c-44bc14013b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa1e9e4-5951-4914-b60c-44bc14013b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62dd892-f419-4bac-b1b0-863cbdd31cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:57 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Volume d3ade58c-2ce7-4845-8888-cdb89e8444fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe', 'volume_size': 1} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-quobyte-0ae23e73-4725-4126-8ca5-68680a23bb3f" released by "delete_volume" :: held 1.673s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Created reservations ['368b079e-4fef-4550-8fa1-b63867a88004', '198a4ebc-598e-4bc2-8c70-8ea402c555e0', 'c67cb40f-bc40-416d-8f36-146ba68aea9a', 'ee1aab56-9b4c-43a7-8e0c-404fbedb5e57'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:57 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:57 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:57 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6" returned: 0 in 0.724s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:57 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 is being set with open permissions: ugo+rw Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "cinder-36df5bec-ec8d-4167-b3ae-a12da9994ee3-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:57 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 Jul 09 15:26:57 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-36df5bec-ec8d-4167-b3ae-a12da9994ee3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "cinder-quobyte-36df5bec-ec8d-4167-b3ae-a12da9994ee3" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-quobyte-36df5bec-ec8d-4167-b3ae-a12da9994ee3" acquired by "delete_volume" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[06345b40-c288-4e28-bbf3-08c10d8dccb5]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:58 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3 Jul 09 15:26:58 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:58 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.666s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:58 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Deleted volume successfully. Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-1fb0f759-8946-4a7a-a801-539e72ff50b5 tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-0ae23e73-4725-4126-8ca5-68680a23bb3f-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:58 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6" returned: 0 in 0.690s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:58 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.info Jul 09 15:26:58 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:58 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3" returned: 0 in 0.814s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:58 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3 Jul 09 15:26:58 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:59 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.info" returned: 0 in 0.667s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:59 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.info is being set with open permissions: ugo+rw Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:59 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.info Jul 09 15:26:59 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:59 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-36df5bec-ec8d-4167-b3ae-a12da9994ee3" returned: 0 in 0.658s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-quobyte-36df5bec-ec8d-4167-b3ae-a12da9994ee3" released by "delete_volume" :: held 1.522s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Created reservations ['2f079c82-d07e-4e04-af65-2ed435f79d32', 'cfc81689-0034-474f-b8ad-31210cb7bee8', 'd2c173ab-2b79-4ac0-b932-6071d9689c92', 'c1db588c-2a9c-4afa-be89-fae3b5d5c879'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:59 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:26:59 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:59 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.info" returned: 0 in 0.673s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.607s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.583s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1083490002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ade58c-2ce7-4845-8888-cdb89e8444fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a036c1e27ef4011a65b57a729cf366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:57Z,use_quota=True,user_id='9de2f97be19d40989c0c6e1bf67b235d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Creating volume d3ade58c-2ce7-4845-8888-cdb89e8444fe {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:00 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:00 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe 1073741824 Jul 09 15:27:00 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:00 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a49111cc-0304-4600-8011-41cd9f626cf1 tempest-ProjectMemberTests-1490863771 None] Create snapshot completed successfully Jul 09 15:27:00 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.650s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:00 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Deleted volume successfully. Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-d3b765a1-cc93-4558-95ad-9429206af1bb tempest-CinderUnicodeTest-1064977357 None] Lock "cinder-36df5bec-ec8d-4167-b3ae-a12da9994ee3-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-c22d5afd-9056-4d59-b471-84f285de16e6-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-c22d5afd-9056-4d59-b471-84f285de16e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-c22d5afd-9056-4d59-b471-84f285de16e6" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-c22d5afd-9056-4d59-b471-84f285de16e6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Deleting offline snapshot c22d5afd-9056-4d59-b471-84f285de16e6 of volume 37a7f2d4-1300-48a1-b49b-bc0f8901dd29 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] snapshot_file for this snap is: volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[806666e0-793e-4f7c-afa2-83a52551c769]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:00 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 Jul 09 15:27:00 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:00 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe 1073741824" returned: 0 in 0.960s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:01 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe Jul 09 15:27:01 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:01 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6" returned: 0 in 0.905s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8215c58d-5a4d-4096-ac2c-75342964184a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:01 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe" returned: 0 in 0.754s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62dd892-f419-4bac-b1b0-863cbdd31cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670d41c1-6185-4604-bb42-718d9f1404fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:01 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Volume volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe (d3ade58c-2ce7-4845-8888-cdb89e8444fe): created successfully Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670d41c1-6185-4604-bb42-718d9f1404fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Flow 'volume_create_manager' (fb4d705c-5c6b-4166-98ab-53f69a839612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:01 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 Jul 09 15:27:01 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:01 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-90c2e6d7-acac-410d-a805-5c4f721b35c1 tempest-ProjectReaderTests-1895945618 None] Created volume successfully. Jul 09 15:27:02 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" returned: 0 in 0.851s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:02 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 Jul 09 15:27:02 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Acquiring lock "cinder-d3ade58c-2ce7-4845-8888-cdb89e8444fe-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:02 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Lock "cinder-d3ade58c-2ce7-4845-8888-cdb89e8444fe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Acquiring lock "cinder-quobyte-d3ade58c-2ce7-4845-8888-cdb89e8444fe" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Lock "cinder-quobyte-d3ade58c-2ce7-4845-8888-cdb89e8444fe" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:03 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[57804598-bdab-412e-8e04-277f422e5f89]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:03 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe Jul 09 15:27:03 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:03 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6" returned: 0 in 0.862s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:03 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6 Jul 09 15:27:03 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:03 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe" returned: 0 in 0.855s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:03 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-765d13cc-09f8-4a60-9516-744b87902aa6 tempest-ProjectAdminTests-930252658 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87042) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 15:27:03 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe Jul 09 15:27:03 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:04 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29.c22d5afd-9056-4d59-b471-84f285de16e6" returned: 0 in 0.692s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-c22d5afd-9056-4d59-b471-84f285de16e6" released by "_delete_snapshot" :: held 3.422s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" released by "delete_snapshot" :: held 3.450s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Created reservations ['6c09ce38-858f-43ad-b274-84c5affddd23', '7afd7963-cffe-4f40-83db-e2a870ab9a13', '57ae0a79-2850-4019-bab5-ceac8a8c0cab', 'b1f046c3-c8c4-4aeb-a1d4-1c2ce80304f7'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:04 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Delete snapshot completed successfully. Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-42d30488-a6d2-47e9-8797-c8a8668ecb1b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-c22d5afd-9056-4d59-b471-84f285de16e6-delete_snapshot" released by "delete_snapshot" :: held 3.590s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:04 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-d3ade58c-2ce7-4845-8888-cdb89e8444fe" returned: 0 in 0.735s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Lock "cinder-quobyte-d3ade58c-2ce7-4845-8888-cdb89e8444fe" released by "delete_volume" :: held 1.645s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Created reservations ['0744c361-95fc-464e-ba9f-71f39ef58c83', '948432bb-966d-4a5e-963a-cf03da30e4ba', 'df3549e7-1b80-4992-b98d-f5cc83c7c731', 'e4ff933d-525f-4574-a0b3-7d5eb50e7d0e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:04 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:04 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-37a7f2d4-1300-48a1-b49b-bc0f8901dd29-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:04 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:04 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-37a7f2d4-1300-48a1-b49b-bc0f8901dd29-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" acquired by "delete_volume" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4c4712-ec3e-4e34-8419-1e0fcb38cf9e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:05 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 Jul 09 15:27:05 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:05 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.963s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:05 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Deleted volume successfully. Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61e7fdc8-a0aa-464b-860c-2b5d376e571c tempest-ProjectReaderTests-1895945618 None] Lock "cinder-d3ade58c-2ce7-4845-8888-cdb89e8444fe-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:05 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.911s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Flow 'volume_create_manager' (5bec8f51-3499-46f7-820f-17f6a5239162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd65490-eec1-4dc5-a8fe-2b01e095b991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd65490-eec1-4dc5-a8fe-2b01e095b991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813818598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24614a8d-9f1f-47c6-8856-4edae92b308e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a036c1e27ef4011a65b57a729cf366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:06Z,use_quota=True,user_id='9de2f97be19d40989c0c6e1bf67b235d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3a6dc2-d181-49d7-a064-76365611dc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3a6dc2-d181-49d7-a064-76365611dc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d0de86-6cf9-45f4-b51c-b45f9095fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d0de86-6cf9-45f4-b51c-b45f9095fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24614a8d-9f1f-47c6-8856-4edae92b308e', 'volume_name': 'volume-24614a8d-9f1f-47c6-8856-4edae92b308e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7570801-0580-4944-9397-11e8a21535c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7570801-0580-4944-9397-11e8a21535c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee20f460-671e-4fca-9745-689859e270b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:05 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Volume 24614a8d-9f1f-47c6-8856-4edae92b308e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24614a8d-9f1f-47c6-8856-4edae92b308e', 'volume_size': 1} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813818598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24614a8d-9f1f-47c6-8856-4edae92b308e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a036c1e27ef4011a65b57a729cf366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:06Z,use_quota=True,user_id='9de2f97be19d40989c0c6e1bf67b235d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Creating volume 24614a8d-9f1f-47c6-8856-4edae92b308e {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:05 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:06 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e 1073741824 Jul 09 15:27:06 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:06 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" returned: 0 in 1.162s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:06 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29 Jul 09 15:27:06 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:06 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" returned: 0 in 0.713s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:07 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e 1073741824" returned: 0 in 1.017s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-37a7f2d4-1300-48a1-b49b-bc0f8901dd29" released by "delete_volume" :: held 1.967s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:07 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e Jul 09 15:27:07 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Created reservations ['e739673f-7bf9-40c6-a52b-ccf4c871f835', '8a6306f5-09c7-4145-9122-cf79436c6da6', '7162b40d-b399-48a4-b123-0ab48a4884d6', 'd1b191d3-4575-4a3c-a9e8-1137ef8b29b2'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:07 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:07 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (5e31acdd-8eb9-4984-ad91-03cc0a3d2163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e819607d-baa5-4c35-97e0-ef317e5051e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:07 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:07 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e819607d-baa5-4c35-97e0-ef317e5051e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130556298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ad9da1-2977-4628-bc1a-0ccabe8e296d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:08Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d1d3f2-fcef-4db3-a738-e15cd7d5b993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d1d3f2-fcef-4db3-a738-e15cd7d5b993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71cbab4-cfec-456c-a90f-aa8943dbb43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71cbab4-cfec-456c-a90f-aa8943dbb43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ad9da1-2977-4628-bc1a-0ccabe8e296d', 'volume_name': 'volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b570af5-6e73-4125-bc7f-820a4a53422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b570af5-6e73-4125-bc7f-820a4a53422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:08 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226d4dae-4a1e-482e-a5c7-ad5714a28ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:08 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Volume f7ad9da1-2977-4628-bc1a-0ccabe8e296d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d', 'volume_size': 1} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.860s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e" returned: 0 in 0.987s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130556298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ad9da1-2977-4628-bc1a-0ccabe8e296d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:08Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Creating volume f7ad9da1-2977-4628-bc1a-0ccabe8e296d {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:08 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:08 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Deleted volume successfully. Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee20f460-671e-4fca-9745-689859e270b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24614a8d-9f1f-47c6-8856-4edae92b308e', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:08 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d 1073741824 Jul 09 15:27:08 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3636e6-1968-4dd1-a7d7-e76dd21307bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-79fa723a-0dc1-4c59-b66b-a5e6d98403a8 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-37a7f2d4-1300-48a1-b49b-bc0f8901dd29-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:08 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Volume volume-24614a8d-9f1f-47c6-8856-4edae92b308e (24614a8d-9f1f-47c6-8856-4edae92b308e): created successfully Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3636e6-1968-4dd1-a7d7-e76dd21307bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Flow 'volume_create_manager' (5bec8f51-3499-46f7-820f-17f6a5239162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:08 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a3a2fec8-c6c5-42a2-aec0-5f62301d381e tempest-ProjectReaderTests-1895945618 None] Created volume successfully. Jul 09 15:27:08 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d 1073741824" returned: 0 in 0.902s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:09 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d Jul 09 15:27:09 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Flow 'volume_create_manager' (78a5b8ac-5d56-4a47-b223-53a3c79a20fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd536be-7313-4ef2-b289-78e9cd8d7313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd536be-7313-4ef2-b289-78e9cd8d7313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041505272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344c4b9c-b3f2-431c-a213-4c5fc87ad83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cdce7c454f4bb8944b6c04f8347922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:09Z,use_quota=True,user_id='9ac4fa13ffd949b3ab7724fc7c417ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bb9b99-07b6-4448-80d2-1d4073601b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bb9b99-07b6-4448-80d2-1d4073601b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad16a8f-15db-4b54-91fa-74eca4c9040c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad16a8f-15db-4b54-91fa-74eca4c9040c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344c4b9c-b3f2-431c-a213-4c5fc87ad83c', 'volume_name': 'volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad07772c-bb02-40da-aa33-5460ff27401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad07772c-bb02-40da-aa33-5460ff27401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d6d48c-837c-4034-a7de-3b4120b53fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:09 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Volume 344c4b9c-b3f2-431c-a213-4c5fc87ad83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c', 'volume_size': 1} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Acquiring lock "cinder-24614a8d-9f1f-47c6-8856-4edae92b308e-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Lock "cinder-24614a8d-9f1f-47c6-8856-4edae92b308e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Acquiring lock "cinder-quobyte-24614a8d-9f1f-47c6-8856-4edae92b308e" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Lock "cinder-quobyte-24614a8d-9f1f-47c6-8856-4edae92b308e" acquired by "delete_volume" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec0da3e-0503-4862-b4ff-2e1145aa23ba]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:09 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e Jul 09 15:27:09 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:09 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" returned: 0 in 0.684s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041505272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344c4b9c-b3f2-431c-a213-4c5fc87ad83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cdce7c454f4bb8944b6c04f8347922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:09Z,use_quota=True,user_id='9ac4fa13ffd949b3ab7724fc7c417ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Creating volume 344c4b9c-b3f2-431c-a213-4c5fc87ad83c {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:09 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:09 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c 1073741824 Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226d4dae-4a1e-482e-a5c7-ad5714a28ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:09 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c292f5c-fe76-4bf6-adc5-c1eb8c6214ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:09 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Volume volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d (f7ad9da1-2977-4628-bc1a-0ccabe8e296d): created successfully Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c292f5c-fe76-4bf6-adc5-c1eb8c6214ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (5e31acdd-8eb9-4984-ad91-03cc0a3d2163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:09 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d5664534-069c-4dee-8219-4ebe03e2d13c tempest-ProjectMemberTests-1490863771 None] Created volume successfully. Jul 09 15:27:10 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e" returned: 0 in 0.881s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:10 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e Jul 09 15:27:10 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:10 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c 1073741824" returned: 0 in 0.897s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:10 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c Jul 09 15:27:10 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:10 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-24614a8d-9f1f-47c6-8856-4edae92b308e" returned: 0 in 0.695s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Lock "cinder-quobyte-24614a8d-9f1f-47c6-8856-4edae92b308e" released by "delete_volume" :: held 1.620s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Created reservations ['7df0e6d9-f555-4a90-a92e-d9f7dae5af29', '258821e8-cd74-4fd8-8b8b-ca2eae091746', '3875a079-e5a5-439e-986d-8d1de93d4450', '412031a8-fc2a-4a12-bbbc-5322cdb74ddf'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=191,cinder:SELECT=133,cinder:INSERT=46,cinder:DELETE=15 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:11 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:11 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:11 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" returned: 0 in 0.709s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.183s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Creating offline snapshot ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 of volume f7ad9da1-2977-4628-bc1a-0ccabe8e296d {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d6d48c-837c-4034-a7de-3b4120b53fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bba06c4-75ea-47fb-8569-9f200de28e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d86d859-497c-49c2-b4cd-4821011dae16]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:11 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Volume volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c (344c4b9c-b3f2-431c-a213-4c5fc87ad83c): created successfully Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bba06c4-75ea-47fb-8569-9f200de28e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Flow 'volume_create_manager' (78a5b8ac-5d56-4a47-b223-53a3c79a20fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-9881e6fe-975e-4a5a-a7f0-7e6d48ceeb51 tempest-ProjectReaderTests-1360878045 None] Created volume successfully. Jul 09 15:27:11 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d Jul 09 15:27:11 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:11 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.740s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Deleted volume successfully. Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=139,cinder:UPDATE=178,cinder:DELETE=14,cinder:INSERT=49 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-b457173e-1219-4187-9a09-c384919812c6 tempest-ProjectReaderTests-1895945618 None] Lock "cinder-24614a8d-9f1f-47c6-8856-4edae92b308e-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Flow 'volume_create_manager' (d9d15140-55e6-4fc6-980d-ae4d12206f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c9d4e5-351b-40bf-8b0d-0f74886d366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c9d4e5-351b-40bf-8b0d-0f74886d366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1959133665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607ae133-c49d-4d03-ac38-a7552a411834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a036c1e27ef4011a65b57a729cf366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:12Z,use_quota=True,user_id='9de2f97be19d40989c0c6e1bf67b235d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c728ef63-2a93-474f-865b-eaab9e7cb7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c728ef63-2a93-474f-865b-eaab9e7cb7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a47b9d-2fcb-4c73-8704-da7815962cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a47b9d-2fcb-4c73-8704-da7815962cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '607ae133-c49d-4d03-ac38-a7552a411834', 'volume_name': 'volume-607ae133-c49d-4d03-ac38-a7552a411834', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f3f4be-d3a0-4574-8c94-97676169cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f3f4be-d3a0-4574-8c94-97676169cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:12 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0348b8c-47f4-43a2-88cf-09e79ede4c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:12 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Volume 607ae133-c49d-4d03-ac38-a7552a411834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-607ae133-c49d-4d03-ac38-a7552a411834', 'volume_size': 1} Jul 09 15:27:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:12 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" returned: 0 in 0.895s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:12 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 1G Jul 09 15:27:12 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:13 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 1G" returned: 0 in 0.802s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:13 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 Jul 09 15:27:13 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:13 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3" returned: 0 in 0.696s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:13 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 is being set with open permissions: ugo+rw Jul 09 15:27:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:13 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 Jul 09 15:27:13 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:14 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3" returned: 0 in 0.635s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:14 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.info Jul 09 15:27:14 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:15 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.info" returned: 0 in 0.648s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:15 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.info is being set with open permissions: ugo+rw Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:15 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.info Jul 09 15:27:15 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:15 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.info" returned: 0 in 0.649s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.767s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1959133665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607ae133-c49d-4d03-ac38-a7552a411834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a036c1e27ef4011a65b57a729cf366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:12Z,use_quota=True,user_id='9de2f97be19d40989c0c6e1bf67b235d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Creating volume 607ae133-c49d-4d03-ac38-a7552a411834 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:15 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:15 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834 1073741824 Jul 09 15:27:15 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:15 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1c6370ae-5798-4ad0-8cb4-c498cad57b27 tempest-ProjectMemberTests-1490863771 None] Create snapshot completed successfully Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Deleting offline snapshot ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 of volume f7ad9da1-2977-4628-bc1a-0ccabe8e296d {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] snapshot_file for this snap is: volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc758f-9031-48c4-b167-3d0f2042493a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:16 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 Jul 09 15:27:16 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:16 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834 1073741824" returned: 0 in 0.904s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:16 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834 Jul 09 15:27:16 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:17 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3" returned: 0 in 0.781s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[905bf2e6-a7dd-4790-a1be-88a29bd4178a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:17 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834" returned: 0 in 0.645s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.992s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0348b8c-47f4-43a2-88cf-09e79ede4c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-607ae133-c49d-4d03-ac38-a7552a411834', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84dd10d3-567d-4d77-bdf6-4b614818f131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Creating offline snapshot 0b95e58f-74b1-499b-a9f3-ce50f2d60e0e of volume 344c4b9c-b3f2-431c-a213-4c5fc87ad83c {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:27:17 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d Jul 09 15:27:17 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:17 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Volume volume-607ae133-c49d-4d03-ac38-a7552a411834 (607ae133-c49d-4d03-ac38-a7552a411834): created successfully Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84dd10d3-567d-4d77-bdf6-4b614818f131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Flow 'volume_create_manager' (d9d15140-55e6-4fc6-980d-ae4d12206f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[00158e76-4f3a-41af-8a67-827ee8a1406a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:17 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-73fcf3d0-e439-466e-85bf-10ec4ea74615 tempest-ProjectReaderTests-1895945618 None] Created volume successfully. Jul 09 15:27:17 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c Jul 09 15:27:17 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:18 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" returned: 0 in 0.769s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:18 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 Jul 09 15:27:18 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:18 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" returned: 0 in 0.867s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Acquiring lock "cinder-607ae133-c49d-4d03-ac38-a7552a411834-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:18 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e 1G Jul 09 15:27:18 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Lock "cinder-607ae133-c49d-4d03-ac38-a7552a411834-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Acquiring lock "cinder-quobyte-607ae133-c49d-4d03-ac38-a7552a411834" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Lock "cinder-quobyte-607ae133-c49d-4d03-ac38-a7552a411834" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b34f0eb-a2b5-4da1-8e4b-9688e24e5296]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:18 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834 Jul 09 15:27:18 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:18 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3" returned: 0 in 0.774s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:18 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3 Jul 09 15:27:18 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:19 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e 1G" returned: 0 in 0.859s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:19 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e Jul 09 15:27:19 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:19 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834" returned: 0 in 0.812s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:19 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834 Jul 09 15:27:19 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:19 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d.ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3" returned: 0 in 0.659s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3" released by "_delete_snapshot" :: held 3.099s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" released by "delete_snapshot" :: held 3.123s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Created reservations ['a7dfa892-3b7d-4789-ad95-6b935812470c', '8b7e59b7-2b6b-4125-88e6-a1090f85a74a', '1f563a41-15ed-4739-9a82-eda8d2f9ee12', 'a89def85-9f2b-4762-8cdc-c019d3bcaf2b'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:19 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Delete snapshot completed successfully. Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-051ab789-1fdf-4646-98cd-3eb03b5a1e50 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-ae63d43c-db0c-4da0-a4f3-6fcda14cc1e3-delete_snapshot" released by "delete_snapshot" :: held 3.278s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:19 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e" returned: 0 in 0.715s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:19 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e is being set with open permissions: ugo+rw Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:19 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e Jul 09 15:27:19 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:19 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-607ae133-c49d-4d03-ac38-a7552a411834" returned: 0 in 0.664s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Lock "cinder-quobyte-607ae133-c49d-4d03-ac38-a7552a411834" released by "delete_volume" :: held 1.524s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:19 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Created reservations ['4e8c1934-c58d-4d0b-8a85-dac6f3bb40b5', 'dd3dd731-35e6-4332-97b9-17e233c59a3d', '3cb3cb14-8430-4788-beee-9618935ddc89', 'cc3f5f14-3fb0-4dde-af71-8430703904d6'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:20 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:20 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:20 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e" returned: 0 in 0.646s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:20 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.info Jul 09 15:27:20 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-f7ad9da1-2977-4628-bc1a-0ccabe8e296d-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Lock "cinder-f7ad9da1-2977-4628-bc1a-0ccabe8e296d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:20 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.729s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:20 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Deleted volume successfully. Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-51289b86-e63e-4fee-9b7e-2dda5545819e tempest-ProjectReaderTests-1895945618 None] Lock "cinder-607ae133-c49d-4d03-ac38-a7552a411834-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[207afdc9-6b71-4281-b8a1-cd533924ea18]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:21 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d Jul 09 15:27:21 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Flow 'volume_create_manager' (f84948ba-41d8-463a-a350-7c085dce7028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f6f275-e074-4879-b974-d6e1db0a6748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f6f275-e074-4879-b974-d6e1db0a6748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301396208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c7dcf6-7cca-483e-a7d5-90bd7022547c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a036c1e27ef4011a65b57a729cf366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:21Z,use_quota=True,user_id='9de2f97be19d40989c0c6e1bf67b235d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a24acf-3b11-434e-b6a6-5bd43e9297e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a24acf-3b11-434e-b6a6-5bd43e9297e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f759f3-be6f-443d-b7e4-8f8563cf8e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f759f3-be6f-443d-b7e4-8f8563cf8e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c7dcf6-7cca-483e-a7d5-90bd7022547c', 'volume_name': 'volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3c7984-c7f9-4359-be3a-958854ab44e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3c7984-c7f9-4359-be3a-958854ab44e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77225f21-bb30-4e94-84e8-1fb039fc8f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Volume 03c7dcf6-7cca-483e-a7d5-90bd7022547c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c', 'volume_size': 1} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:21 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.info" returned: 0 in 0.758s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:21 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.info is being set with open permissions: ugo+rw Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:21 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.info Jul 09 15:27:21 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:21 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" returned: 0 in 0.838s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:21 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d Jul 09 15:27:21 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:21 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.info" returned: 0 in 0.660s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.649s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301396208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c7dcf6-7cca-483e-a7d5-90bd7022547c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a036c1e27ef4011a65b57a729cf366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:21Z,use_quota=True,user_id='9de2f97be19d40989c0c6e1bf67b235d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Creating volume 03c7dcf6-7cca-483e-a7d5-90bd7022547c {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:22 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:22 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c 1073741824 Jul 09 15:27:22 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ec1c53a5-4c59-40ad-87f1-45c4f66b6da4 tempest-ProjectReaderTests-1360878045 None] Create snapshot completed successfully Jul 09 15:27:22 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" returned: 0 in 0.632s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-f7ad9da1-2977-4628-bc1a-0ccabe8e296d" released by "delete_volume" :: held 1.532s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Created reservations ['f2a0a8e6-fa49-4528-a7d2-8e86fc3428b6', '33f7bbe7-5091-439c-afc7-f32a90884708', '0e32edb3-9e2d-41f1-8002-520206189683', '3d627694-8668-4295-a5b7-1b7109e36cf4'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:22 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:22 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:22 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c 1073741824" returned: 0 in 0.864s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:22 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c Jul 09 15:27:22 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-0b95e58f-74b1-499b-a9f3-ce50f2d60e0e-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-0b95e58f-74b1-499b-a9f3-ce50f2d60e0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-0b95e58f-74b1-499b-a9f3-ce50f2d60e0e" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-0b95e58f-74b1-499b-a9f3-ce50f2d60e0e" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Deleting offline snapshot 0b95e58f-74b1-499b-a9f3-ce50f2d60e0e of volume 344c4b9c-b3f2-431c-a213-4c5fc87ad83c {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] snapshot_file for this snap is: volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:27:23 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ccb65f-8e3a-4508-b1a1-e57e23601cc0]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.744s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:23 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Deleted volume successfully. Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-61d78630-45ab-4d9e-b71b-c726569229fb tempest-ProjectMemberTests-1490863771 None] Lock "cinder-f7ad9da1-2977-4628-bc1a-0ccabe8e296d-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:23 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e Jul 09 15:27:23 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (121bd02c-ba34-4120-b0f7-98a74876dd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8037cfc-3d28-43f5-bdd6-712c97765464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8037cfc-3d28-43f5-bdd6-712c97765464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1724379597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d985327-d7ea-4186-912f-7d3503b58380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:23Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b4ff2c-055a-411d-8fd4-319f64a74d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b4ff2c-055a-411d-8fd4-319f64a74d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34166a85-476e-4eaa-a894-1b69b5b2a24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34166a85-476e-4eaa-a894-1b69b5b2a24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d985327-d7ea-4186-912f-7d3503b58380', 'volume_name': 'volume-9d985327-d7ea-4186-912f-7d3503b58380', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46a0f0f-c9e6-453f-a21d-7a2e1d7ea6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46a0f0f-c9e6-453f-a21d-7a2e1d7ea6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c535e582-53ae-4933-9774-a2817ed4973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Volume 9d985327-d7ea-4186-912f-7d3503b58380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d985327-d7ea-4186-912f-7d3503b58380', 'volume_size': 1} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:23 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c" returned: 0 in 0.840s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1724379597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d985327-d7ea-4186-912f-7d3503b58380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:23Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Creating volume 9d985327-d7ea-4186-912f-7d3503b58380 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:23 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:23 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 1073741824 Jul 09 15:27:23 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77225f21-bb30-4e94-84e8-1fb039fc8f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d8bb9e-e215-4905-aada-f0e9ab135881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:23 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Volume volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c (03c7dcf6-7cca-483e-a7d5-90bd7022547c): created successfully Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d8bb9e-e215-4905-aada-f0e9ab135881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:23 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Flow 'volume_create_manager' (f84948ba-41d8-463a-a350-7c085dce7028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:23 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2f3009ce-a6f6-4815-9060-fce5a8d005a0 tempest-ProjectReaderTests-1895945618 None] Created volume successfully. Jul 09 15:27:24 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e" returned: 0 in 0.815s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[7048a4a5-c112-4d85-8f7a-fb059402a754]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:24 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c Jul 09 15:27:24 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Acquiring lock "cinder-03c7dcf6-7cca-483e-a7d5-90bd7022547c-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Lock "cinder-03c7dcf6-7cca-483e-a7d5-90bd7022547c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Acquiring lock "cinder-quobyte-03c7dcf6-7cca-483e-a7d5-90bd7022547c" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Lock "cinder-quobyte-03c7dcf6-7cca-483e-a7d5-90bd7022547c" acquired by "delete_volume" :: waited 0.032s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a1e8fe-f87d-4ef6-a1b9-476a2ed23e2e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:24 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c Jul 09 15:27:24 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:24 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 1073741824" returned: 0 in 0.937s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:24 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 Jul 09 15:27:24 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:24 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" returned: 0 in 0.743s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:24 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e Jul 09 15:27:24 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:25 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c" returned: 0 in 0.801s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:25 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c Jul 09 15:27:25 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:25 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380" returned: 0 in 0.632s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c535e582-53ae-4933-9774-a2817ed4973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d985327-d7ea-4186-912f-7d3503b58380', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71555589-7a7f-4149-b9af-53a061d7b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:25 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Volume volume-9d985327-d7ea-4186-912f-7d3503b58380 (9d985327-d7ea-4186-912f-7d3503b58380): created successfully Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71555589-7a7f-4149-b9af-53a061d7b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (121bd02c-ba34-4120-b0f7-98a74876dd46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-89aaddcd-526b-4b50-8048-275fd8747d33 tempest-ProjectMemberTests-1490863771 None] Created volume successfully. Jul 09 15:27:25 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e" returned: 0 in 0.811s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:25 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e Jul 09 15:27:25 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Creating offline snapshot 72e27976-5105-4b1a-9a6a-d470be18f5a5 of volume 9d985327-d7ea-4186-912f-7d3503b58380 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6180606-4898-4310-9b42-e5e9524c3efc]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:25 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 Jul 09 15:27:25 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:26 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-03c7dcf6-7cca-483e-a7d5-90bd7022547c" returned: 0 in 0.753s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Lock "cinder-quobyte-03c7dcf6-7cca-483e-a7d5-90bd7022547c" released by "delete_volume" :: held 1.606s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Created reservations ['47cad129-1edc-483d-9118-93fe2e9be989', 'da583870-a4cc-415a-b85c-ed54dde28ca8', '8b4e36cd-d076-49b7-bd7a-c9000de724b6', '7d8eb0a9-a7dd-4ab4-942b-155e7328bc3c'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:26 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:26 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:26 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c.0b95e58f-74b1-499b-a9f3-ce50f2d60e0e" returned: 0 in 0.700s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-0b95e58f-74b1-499b-a9f3-ce50f2d60e0e" released by "_delete_snapshot" :: held 3.199s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" released by "delete_snapshot" :: held 3.247s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Created reservations ['ac650d62-0f18-451e-b0e7-fdc68a59ec28', '4d99e491-774a-41cd-97ce-e494368bb02b', '38a958a5-8d81-4772-bfe2-df3a7481d953', '4c36ed55-a861-4c51-b12e-67e2eadaab43'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Delete snapshot completed successfully. Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-284b02a9-13f2-4f8d-b022-f6f149fe48d2 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-0b95e58f-74b1-499b-a9f3-ce50f2d60e0e-delete_snapshot" released by "delete_snapshot" :: held 3.407s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:26 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380" returned: 0 in 0.818s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:26 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 1G Jul 09 15:27:26 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:26 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.674s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:26 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Deleted volume successfully. Jul 09 15:27:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-a9bf9d5a-725c-4f79-85ad-0c3193d5271d tempest-ProjectReaderTests-1895945618 None] Lock "cinder-03c7dcf6-7cca-483e-a7d5-90bd7022547c-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-344c4b9c-b3f2-431c-a213-4c5fc87ad83c-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-344c4b9c-b3f2-431c-a213-4c5fc87ad83c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" acquired by "delete_volume" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:27 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0e9318-d653-4ded-8fe4-65af79008bfe]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:27 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c Jul 09 15:27:27 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:27 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 1G" returned: 0 in 0.970s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d985327-d7ea-4186-912f-7d3503b58380 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:27 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d985327-d7ea-4186-912f-7d3503b58380 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 Jul 09 15:27:27 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:28 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" returned: 0 in 0.917s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:28 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c Jul 09 15:27:28 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:28 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d985327-d7ea-4186-912f-7d3503b58380 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5" returned: 0 in 0.826s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:28 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 is being set with open permissions: ugo+rw Jul 09 15:27:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:28 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 Jul 09 15:27:28 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:29 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" returned: 0 in 0.713s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-344c4b9c-b3f2-431c-a213-4c5fc87ad83c" released by "delete_volume" :: held 1.694s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:29 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5" returned: 0 in 0.662s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Created reservations ['450d41a6-4f5f-49f0-8bf1-8c588a8c2ae5', '26b019fb-776c-4a10-b740-61477a454480', '7cfabaa5-386d-4ccd-849e-446ff7c9e7de', 'bb47c8e2-011d-4f68-9bf3-be2dfd16570e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:29 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.info Jul 09 15:27:29 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:29 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:29 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:29 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.info" returned: 0 in 0.702s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:29 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.info is being set with open permissions: ugo+rw Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:29 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.info Jul 09 15:27:29 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:29 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.663s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:29 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Deleted volume successfully. Jul 09 15:27:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-6ccb7485-0fab-4057-a069-212d9fc28c46 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-344c4b9c-b3f2-431c-a213-4c5fc87ad83c-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Flow 'volume_create_manager' (2342e8be-67e6-421a-9090-fe4c714575e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a77d90-d9f8-429b-8d94-5190da423cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a77d90-d9f8-429b-8d94-5190da423cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-362991651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b641e6-f002-4a02-a0c4-1b500b7e0caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cdce7c454f4bb8944b6c04f8347922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:30Z,use_quota=True,user_id='9ac4fa13ffd949b3ab7724fc7c417ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa20455-21e3-4438-893b-1a0db1d6d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa20455-21e3-4438-893b-1a0db1d6d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88aa2b2d-02b9-486a-bad0-95588e88285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88aa2b2d-02b9-486a-bad0-95588e88285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b641e6-f002-4a02-a0c4-1b500b7e0caf', 'volume_name': 'volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68aba2a0-b5da-481c-80d8-505c7c06c91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68aba2a0-b5da-481c-80d8-505c7c06c91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d71afdf-5a66-44f0-887a-20e537ac162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:30 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Volume 56b641e6-f002-4a02-a0c4-1b500b7e0caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf', 'volume_size': 1} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:30 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.info" returned: 0 in 0.660s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.737s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-362991651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b641e6-f002-4a02-a0c4-1b500b7e0caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cdce7c454f4bb8944b6c04f8347922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:30Z,use_quota=True,user_id='9ac4fa13ffd949b3ab7724fc7c417ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Creating volume 56b641e6-f002-4a02-a0c4-1b500b7e0caf {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:30 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:30 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf 1073741824 Jul 09 15:27:30 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:30 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2916b0e3-625e-48a3-a51c-3bdd145f2f27 tempest-ProjectMemberTests-1490863771 None] Create snapshot completed successfully Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-72e27976-5105-4b1a-9a6a-d470be18f5a5-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-72e27976-5105-4b1a-9a6a-d470be18f5a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-9d985327-d7ea-4186-912f-7d3503b58380" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-9d985327-d7ea-4186-912f-7d3503b58380" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-72e27976-5105-4b1a-9a6a-d470be18f5a5" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-72e27976-5105-4b1a-9a6a-d470be18f5a5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Deleting offline snapshot 72e27976-5105-4b1a-9a6a-d470be18f5a5 of volume 9d985327-d7ea-4186-912f-7d3503b58380 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] snapshot_file for this snap is: volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9733970-e3c1-4cef-811a-a86f88fc7722]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:31 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 Jul 09 15:27:31 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:31 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf 1073741824" returned: 0 in 0.828s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:31 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf Jul 09 15:27:31 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:31 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5" returned: 0 in 0.754s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d985327-d7ea-4186-912f-7d3503b58380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b19a57-0428-4262-9275-0d03ed6f8aee]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:32 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 Jul 09 15:27:32 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:32 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf" returned: 0 in 0.660s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:32 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d71afdf-5a66-44f0-887a-20e537ac162e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26644991-b7f6-4789-8182-1dd5312ed1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:32 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Volume volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf (56b641e6-f002-4a02-a0c4-1b500b7e0caf): created successfully Jul 09 15:27:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26644991-b7f6-4789-8182-1dd5312ed1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:32 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Flow 'volume_create_manager' (2342e8be-67e6-421a-9090-fe4c714575e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-60419db4-db53-485e-a46a-907dd65f5499 tempest-ProjectReaderTests-1360878045 None] Created volume successfully. Jul 09 15:27:32 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380" returned: 0 in 0.742s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:32 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 Jul 09 15:27:32 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Creating offline snapshot 82d3c784-48c1-4bde-92a4-52dc02aad20d of volume 56b641e6-f002-4a02-a0c4-1b500b7e0caf {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:27:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada077ec-86cc-44f1-b67f-3918a06215a9]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:33 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5" returned: 0 in 0.759s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:33 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf Jul 09 15:27:33 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:33 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5 Jul 09 15:27:33 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:34 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380.72e27976-5105-4b1a-9a6a-d470be18f5a5" returned: 0 in 0.647s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:34 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-72e27976-5105-4b1a-9a6a-d470be18f5a5" released by "_delete_snapshot" :: held 2.993s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf" returned: 0 in 0.773s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-9d985327-d7ea-4186-912f-7d3503b58380" released by "delete_snapshot" :: held 3.028s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:34 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d 1G Jul 09 15:27:34 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:34 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Created reservations ['ac5fdb96-1e3b-4d56-bcb8-7b0255fc6d55', 'd57fd265-ec05-4611-b5ae-fbe89178eb8a', 'ffb0dff3-585f-490f-8a0f-26ccad0f0e29', 'c5d4f36c-6068-4126-8c2b-e84563f48bc9'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Delete snapshot completed successfully. Jul 09 15:27:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c9bb3b27-f6ba-4656-8a48-02202076dc0b tempest-ProjectMemberTests-1490863771 None] Lock "cinder-72e27976-5105-4b1a-9a6a-d470be18f5a5-delete_snapshot" released by "delete_snapshot" :: held 3.173s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:34 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d 1G" returned: 0 in 0.767s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:34 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d Jul 09 15:27:34 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-9d985327-d7ea-4186-912f-7d3503b58380-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-9d985327-d7ea-4186-912f-7d3503b58380-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-9d985327-d7ea-4186-912f-7d3503b58380" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-9d985327-d7ea-4186-912f-7d3503b58380" acquired by "delete_volume" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:35 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab1b174-bc87-4d11-b98b-4533347d3750]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:35 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 Jul 09 15:27:35 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:35 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d" returned: 0 in 0.722s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:35 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d is being set with open permissions: ugo+rw Jul 09 15:27:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:35 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d Jul 09 15:27:35 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:36 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380" returned: 0 in 0.744s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:36 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380 Jul 09 15:27:36 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:36 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d" returned: 0 in 0.623s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:36 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.info Jul 09 15:27:36 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:36 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-9d985327-d7ea-4186-912f-7d3503b58380" returned: 0 in 0.643s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-9d985327-d7ea-4186-912f-7d3503b58380" released by "delete_volume" :: held 1.455s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Created reservations ['feace5ec-75ab-453c-a0eb-07490a543339', '186f0161-3ce2-4926-8c0e-fe3db2002af2', '62d2e0ee-42a2-4ad2-b2e5-07241bfd70bd', '7aa7c793-e2c0-4402-959e-c63a57d15e51'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:36 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.info" returned: 0 in 0.708s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:36 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.info is being set with open permissions: ugo+rw Jul 09 15:27:36 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:36 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:36 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:37 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.info Jul 09 15:27:37 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:37 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.674s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:37 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Deleted volume successfully. Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.info" returned: 0 in 0.679s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.355s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-75290020-b964-440a-8b8a-772458b32300 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-9d985327-d7ea-4186-912f-7d3503b58380-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:37 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-3cdfe975-1e2f-4151-978e-76f1f437289f tempest-ProjectReaderTests-1360878045 None] Create snapshot completed successfully Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (5805b997-9798-4ca5-863f-180d3eb37c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9afb29-db48-4f6a-95a5-bfe5f8530f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9afb29-db48-4f6a-95a5-bfe5f8530f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992749222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3994b5f1-a101-4237-a9be-def5a3dba354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:38Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1504cb-0a5d-4807-abd5-785d64a1d08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1504cb-0a5d-4807-abd5-785d64a1d08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:37 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e298e71-e957-43c9-8191-af637a413be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e298e71-e957-43c9-8191-af637a413be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3994b5f1-a101-4237-a9be-def5a3dba354', 'volume_name': 'volume-3994b5f1-a101-4237-a9be-def5a3dba354', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d575741b-1b38-4006-962e-976320be3feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d575741b-1b38-4006-962e-976320be3feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793267b3-c3b9-4272-b4d0-fa71facd3a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:38 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Volume 3994b5f1-a101-4237-a9be-def5a3dba354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3994b5f1-a101-4237-a9be-def5a3dba354', 'volume_size': 1} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992749222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3994b5f1-a101-4237-a9be-def5a3dba354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:38Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Creating volume 3994b5f1-a101-4237-a9be-def5a3dba354 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:38 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:38 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 1073741824 Jul 09 15:27:38 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-82d3c784-48c1-4bde-92a4-52dc02aad20d-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-82d3c784-48c1-4bde-92a4-52dc02aad20d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-56b641e6-f002-4a02-a0c4-1b500b7e0caf" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-56b641e6-f002-4a02-a0c4-1b500b7e0caf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-82d3c784-48c1-4bde-92a4-52dc02aad20d" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-82d3c784-48c1-4bde-92a4-52dc02aad20d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Deleting offline snapshot 82d3c784-48c1-4bde-92a4-52dc02aad20d of volume 56b641e6-f002-4a02-a0c4-1b500b7e0caf {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] snapshot_file for this snap is: volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[148fa106-018b-4a5f-aabf-81cfc507bb1b]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:38 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d Jul 09 15:27:38 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:38 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 1073741824" returned: 0 in 0.874s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:38 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:38 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 Jul 09 15:27:38 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:39 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d" returned: 0 in 0.777s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67e51fd-b15b-4947-bf66-2e23a5161d11]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:39 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf Jul 09 15:27:39 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:39 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354" returned: 0 in 0.665s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793267b3-c3b9-4272-b4d0-fa71facd3a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3994b5f1-a101-4237-a9be-def5a3dba354', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2cb0a2-d5d3-4569-8941-78313006bb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:39 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Volume volume-3994b5f1-a101-4237-a9be-def5a3dba354 (3994b5f1-a101-4237-a9be-def5a3dba354): created successfully Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2cb0a2-d5d3-4569-8941-78313006bb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:39 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (5805b997-9798-4ca5-863f-180d3eb37c35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:39 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-b80fcd7a-69e4-4ad0-b7ee-d2a04fcd1e55 tempest-ProjectMemberTests-1490863771 None] Created volume successfully. Jul 09 15:27:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:40 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Creating offline snapshot 49adb80e-f604-4e68-a7a0-fac3dce619e5 of volume 3994b5f1-a101-4237-a9be-def5a3dba354 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:27:40 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b5261b-7f63-419e-ade3-0de8cf14d439]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:40 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf" returned: 0 in 0.775s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:40 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d Jul 09 15:27:40 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:40 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 Jul 09 15:27:40 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:40 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354" returned: 0 in 0.749s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:40 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:41 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:41 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 1G Jul 09 15:27:41 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d" returned: 0 in 0.754s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:41 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d Jul 09 15:27:41 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:41 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf.82d3c784-48c1-4bde-92a4-52dc02aad20d" returned: 0 in 0.616s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-82d3c784-48c1-4bde-92a4-52dc02aad20d" released by "_delete_snapshot" :: held 3.022s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-56b641e6-f002-4a02-a0c4-1b500b7e0caf" released by "delete_snapshot" :: held 3.052s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:41 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Created reservations ['9e494380-ddcd-4b86-b956-049f0ff66932', '110606ef-ae79-4d73-81b5-df234a356dc9', 'bc72677d-7ff9-4d94-8bbb-e78bb7f26004', '3013d591-8da7-471d-a3f5-2ff87b488282'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:41 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Delete snapshot completed successfully. Jul 09 15:27:41 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 1G" returned: 0 in 0.816s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:41 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3994b5f1-a101-4237-a9be-def5a3dba354 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:41 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-cd34bac2-2ccb-4ca3-9b67-1459de6b97d7 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-82d3c784-48c1-4bde-92a4-52dc02aad20d-delete_snapshot" released by "delete_snapshot" :: held 3.214s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:41 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3994b5f1-a101-4237-a9be-def5a3dba354 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 Jul 09 15:27:41 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:42 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3994b5f1-a101-4237-a9be-def5a3dba354 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5" returned: 0 in 0.675s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:42 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 is being set with open permissions: ugo+rw Jul 09 15:27:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:42 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 Jul 09 15:27:42 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-56b641e6-f002-4a02-a0c4-1b500b7e0caf-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-56b641e6-f002-4a02-a0c4-1b500b7e0caf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-56b641e6-f002-4a02-a0c4-1b500b7e0caf" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:42 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-56b641e6-f002-4a02-a0c4-1b500b7e0caf" acquired by "delete_volume" :: waited 0.013s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:42 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d9ecb-1942-43fe-a274-4352d0932b53]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:42 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:43 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf Jul 09 15:27:43 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:43 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5" returned: 0 in 0.673s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:43 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.info Jul 09 15:27:43 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:43 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf" returned: 0 in 0.765s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:43 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf Jul 09 15:27:43 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:43 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.info" returned: 0 in 0.660s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:43 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.info is being set with open permissions: ugo+rw Jul 09 15:27:43 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:43 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.info Jul 09 15:27:43 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:44 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-56b641e6-f002-4a02-a0c4-1b500b7e0caf" returned: 0 in 0.628s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-56b641e6-f002-4a02-a0c4-1b500b7e0caf" released by "delete_volume" :: held 1.455s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Created reservations ['f3bda873-8684-42c2-80b2-0acf17aae8cb', '2f4a2e39-9e74-4144-a9e1-aaa6c49e92c5', 'f5ffd7e6-30f7-4c73-b3c2-9de6242e3303', 'a0dd9144-df63-4478-98b5-bfe89c6ba5ae'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:44 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:44 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:44 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.info" returned: 0 in 0.678s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:44 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.328s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:44 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-97bce5d8-4d4e-4471-b54c-f3889813d5c9 tempest-ProjectMemberTests-1490863771 None] Create snapshot completed successfully Jul 09 15:27:45 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.632s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:45 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Deleted volume successfully. Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-e8e3ea25-d736-4022-a6c5-201320e75597 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-56b641e6-f002-4a02-a0c4-1b500b7e0caf-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-49adb80e-f604-4e68-a7a0-fac3dce619e5-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-49adb80e-f604-4e68-a7a0-fac3dce619e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-3994b5f1-a101-4237-a9be-def5a3dba354" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-3994b5f1-a101-4237-a9be-def5a3dba354" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-49adb80e-f604-4e68-a7a0-fac3dce619e5" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-49adb80e-f604-4e68-a7a0-fac3dce619e5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Deleting offline snapshot 49adb80e-f604-4e68-a7a0-fac3dce619e5 of volume 3994b5f1-a101-4237-a9be-def5a3dba354 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] snapshot_file for this snap is: volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Flow 'volume_create_manager' (50a7336c-dd7a-41de-9d7f-3f8a66bcad28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81eb7704-0345-419d-bc8c-d268b70c562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[2793c701-5234-413a-8a9f-b6ba4f3eb6a6]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81eb7704-0345-419d-bc8c-d268b70c562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1301507827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b665d6-2690-4298-b0aa-8e286455a138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cdce7c454f4bb8944b6c04f8347922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:45Z,use_quota=True,user_id='9ac4fa13ffd949b3ab7724fc7c417ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e1fce1-b900-4a96-9cc6-4bd1c7eefd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e1fce1-b900-4a96-9cc6-4bd1c7eefd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2af4f88-8270-4b47-9d00-92ba4dd510cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2af4f88-8270-4b47-9d00-92ba4dd510cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b665d6-2690-4298-b0aa-8e286455a138', 'volume_name': 'volume-a7b665d6-2690-4298-b0aa-8e286455a138', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5d6484-e81d-483f-a224-eabb7f2683ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5d6484-e81d-483f-a224-eabb7f2683ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0788be95-42f5-466c-9100-f5964d09c3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:45 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Volume a7b665d6-2690-4298-b0aa-8e286455a138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b665d6-2690-4298-b0aa-8e286455a138', 'volume_size': 1} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1301507827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b665d6-2690-4298-b0aa-8e286455a138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cdce7c454f4bb8944b6c04f8347922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:45Z,use_quota=True,user_id='9ac4fa13ffd949b3ab7724fc7c417ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Creating volume a7b665d6-2690-4298-b0aa-8e286455a138 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:45 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:45 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:45 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 1073741824 Jul 09 15:27:45 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:45 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 Jul 09 15:27:45 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:46 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5" returned: 0 in 0.768s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:46 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3994b5f1-a101-4237-a9be-def5a3dba354(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:27:46 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92d4037-662f-42b8-9daa-45f5d57691a7]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:46 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 1073741824" returned: 0 in 0.826s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:46 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 Jul 09 15:27:46 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:46 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:46 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 Jul 09 15:27:46 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:47 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354" returned: 0 in 0.792s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:47 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138" returned: 0 in 0.657s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:47 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 Jul 09 15:27:47 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0788be95-42f5-466c-9100-f5964d09c3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b665d6-2690-4298-b0aa-8e286455a138', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8834bffe-6e2e-41c2-a80a-73b3922f3cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:47 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Volume volume-a7b665d6-2690-4298-b0aa-8e286455a138 (a7b665d6-2690-4298-b0aa-8e286455a138): created successfully Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8834bffe-6e2e-41c2-a80a-73b3922f3cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Flow 'volume_create_manager' (50a7336c-dd7a-41de-9d7f-3f8a66bcad28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:47 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2d9a7fbb-ffcd-441b-a2a7-b2022fa94079 tempest-ProjectReaderTests-1360878045 None] Created volume successfully. Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Creating offline snapshot de310129-b818-4a1d-8760-1cdc3079ad15 of volume a7b665d6-2690-4298-b0aa-8e286455a138 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[271de132-dea9-4bb5-a68e-638e665cface]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:47 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 Jul 09 15:27:47 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:47 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5" returned: 0 in 0.735s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:47 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:47 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5 Jul 09 15:27:47 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:48 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138" returned: 0 in 0.761s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:48 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 1G Jul 09 15:27:48 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:48 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:48 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354.49adb80e-f604-4e68-a7a0-fac3dce619e5" returned: 0 in 0.685s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-49adb80e-f604-4e68-a7a0-fac3dce619e5" released by "_delete_snapshot" :: held 3.109s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-3994b5f1-a101-4237-a9be-def5a3dba354" released by "delete_snapshot" :: held 3.142s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:48 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Created reservations ['0e7db05b-40b2-4511-ba09-9259178ab59b', '373adac3-b0c7-4802-868e-ea96f8175bcb', '5059b27c-f117-434c-a7c5-70183e0e690f', 'c59bd336-c59e-4f73-a55d-d4dfc837089b'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:48 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Delete snapshot completed successfully. Jul 09 15:27:48 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-50e54700-1866-459c-89ba-9283cc5f5c38 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-49adb80e-f604-4e68-a7a0-fac3dce619e5-delete_snapshot" released by "delete_snapshot" :: held 3.287s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:49 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 1G" returned: 0 in 0.820s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7b665d6-2690-4298-b0aa-8e286455a138 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:49 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7b665d6-2690-4298-b0aa-8e286455a138 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 Jul 09 15:27:49 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-3994b5f1-a101-4237-a9be-def5a3dba354-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-3994b5f1-a101-4237-a9be-def5a3dba354-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-3994b5f1-a101-4237-a9be-def5a3dba354" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:49 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-3994b5f1-a101-4237-a9be-def5a3dba354" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:49 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[333914ee-97bf-4acf-95fa-3854307cc746]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:49 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:49 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 Jul 09 15:27:49 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:50 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7b665d6-2690-4298-b0aa-8e286455a138 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15" returned: 0 in 0.719s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:50 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 is being set with open permissions: ugo+rw Jul 09 15:27:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:50 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 Jul 09 15:27:50 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:50 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354" returned: 0 in 0.743s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:50 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354 Jul 09 15:27:50 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:50 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15" returned: 0 in 0.646s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:50 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:50 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.info Jul 09 15:27:50 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:51 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-3994b5f1-a101-4237-a9be-def5a3dba354" returned: 0 in 0.628s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-3994b5f1-a101-4237-a9be-def5a3dba354" released by "delete_volume" :: held 1.451s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Created reservations ['26f9951a-9180-4044-9921-cf472515e911', 'c656f839-c492-494b-944c-0392325d3f07', '0478935d-6706-40e1-84f5-2f3fffd3dae4', '3bb08d31-0546-42fe-a042-b4f4543ceee1'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:51 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:51 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:51 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.info" returned: 0 in 0.704s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:51 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.info is being set with open permissions: ugo+rw Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:51 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.info Jul 09 15:27:51 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:51 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.657s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:51 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:51 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Deleted volume successfully. Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-036fa5c9-56d3-4150-9704-1b22c7a9cf72 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-3994b5f1-a101-4237-a9be-def5a3dba354-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:52 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.info" returned: 0 in 0.672s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.403s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:52 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-57e0d5f3-8fb2-4fa3-9eb9-f9ac05fea656 tempest-ProjectReaderTests-1360878045 None] Create snapshot completed successfully Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (fabb42cd-4dcc-4ed0-aae2-ebf5282419f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abbcc43-628c-4530-94e0-3b881349a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abbcc43-628c-4530-94e0-3b881349a8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103520968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea310fc-1786-4a77-8b31-6e11c9d84cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:52Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49541c7f-73a0-439c-a915-270236dc6674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49541c7f-73a0-439c-a915-270236dc6674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a18d9e2-85af-4560-8353-1a9dc505a251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a18d9e2-85af-4560-8353-1a9dc505a251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ea310fc-1786-4a77-8b31-6e11c9d84cad', 'volume_name': 'volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2abb6271-ffc1-4c5c-80e3-fd8e0b0dc2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2abb6271-ffc1-4c5c-80e3-fd8e0b0dc2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e50f2e-0740-4252-9e54-79b8cce3806f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:52 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Volume 2ea310fc-1786-4a77-8b31-6e11c9d84cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad', 'volume_size': 1} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103520968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea310fc-1786-4a77-8b31-6e11c9d84cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:52Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Creating volume 2ea310fc-1786-4a77-8b31-6e11c9d84cad {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:52 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:52 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad 1073741824 Jul 09 15:27:52 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:52 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-de310129-b818-4a1d-8760-1cdc3079ad15-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Lock "cinder-de310129-b818-4a1d-8760-1cdc3079ad15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-a7b665d6-2690-4298-b0aa-8e286455a138" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-a7b665d6-2690-4298-b0aa-8e286455a138" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-de310129-b818-4a1d-8760-1cdc3079ad15" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-de310129-b818-4a1d-8760-1cdc3079ad15" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Deleting offline snapshot de310129-b818-4a1d-8760-1cdc3079ad15 of volume a7b665d6-2690-4298-b0aa-8e286455a138 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] snapshot_file for this snap is: volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7334801-9f22-486b-b0cd-1e7a09fd59fd]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:53 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 Jul 09 15:27:53 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:53 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad 1073741824" returned: 0 in 0.898s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:53 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad Jul 09 15:27:53 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:53 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15" returned: 0 in 0.763s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7b665d6-2690-4298-b0aa-8e286455a138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[93baf570-caa7-415b-adc9-351085c47006]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:53 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:53 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 Jul 09 15:27:53 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:53 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad" returned: 0 in 0.647s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e50f2e-0740-4252-9e54-79b8cce3806f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f131d4b-6ea3-44a5-a49e-218293470c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:54 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Volume volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad (2ea310fc-1786-4a77-8b31-6e11c9d84cad): created successfully Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f131d4b-6ea3-44a5-a49e-218293470c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (fabb42cd-4dcc-4ed0-aae2-ebf5282419f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:54 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-e8ba9f01-bab4-4815-9451-1a964121ecd4 tempest-ProjectMemberTests-1490863771 None] Created volume successfully. Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Creating offline snapshot b78301dd-b41d-4d67-a038-f1da7a6f41ff of volume 2ea310fc-1786-4a77-8b31-6e11c9d84cad {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eea56b-ba16-4dfd-8542-443d92674687]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:54 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138" returned: 0 in 0.800s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:54 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:54 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 Jul 09 15:27:54 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:54 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad Jul 09 15:27:54 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:55 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15" returned: 0 in 0.711s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:55 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad" returned: 0 in 0.798s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:55 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:55 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15 Jul 09 15:27:55 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:55 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff 1G Jul 09 15:27:55 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:56 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138.de310129-b818-4a1d-8760-1cdc3079ad15" returned: 0 in 0.656s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-de310129-b818-4a1d-8760-1cdc3079ad15" released by "_delete_snapshot" :: held 3.029s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-a7b665d6-2690-4298-b0aa-8e286455a138" released by "delete_snapshot" :: held 3.052s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:56 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Created reservations ['9c43e60f-d04b-4c54-a865-c39c2094deb8', '27f55826-f920-45d8-afda-5732cdbf9c6c', 'bea0e51f-20de-469e-801c-a318a6e5c901', 'b5a58e96-612c-4898-aca6-059100f49bef'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:56 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Delete snapshot completed successfully. Jul 09 15:27:56 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2faf6c8-6776-4970-909d-5c1fe18de6ef tempest-ProjectReaderTests-1360878045 None] Lock "cinder-de310129-b818-4a1d-8760-1cdc3079ad15-delete_snapshot" released by "delete_snapshot" :: held 3.189s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:56 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff 1G" returned: 0 in 0.847s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:56 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff Jul 09 15:27:56 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:56 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff" returned: 0 in 0.683s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:56 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff is being set with open permissions: ugo+rw Jul 09 15:27:56 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:56 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff Jul 09 15:27:56 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-a7b665d6-2690-4298-b0aa-8e286455a138-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Lock "cinder-a7b665d6-2690-4298-b0aa-8e286455a138-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-a7b665d6-2690-4298-b0aa-8e286455a138" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:57 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-a7b665d6-2690-4298-b0aa-8e286455a138" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:57 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb56371-8af3-4411-ac16-8b379c216682]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:57 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 Jul 09 15:27:57 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:57 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff" returned: 0 in 0.684s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:57 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:57 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.info Jul 09 15:27:57 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:58 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138" returned: 0 in 0.795s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:58 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138 Jul 09 15:27:58 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:58 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.info" returned: 0 in 0.684s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:58 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.info is being set with open permissions: ugo+rw Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:58 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.info Jul 09 15:27:58 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:58 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-a7b665d6-2690-4298-b0aa-8e286455a138" returned: 0 in 0.660s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-a7b665d6-2690-4298-b0aa-8e286455a138" released by "delete_volume" :: held 1.522s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Created reservations ['e47cc466-0060-4507-bf66-dd47d5829ca6', '57b8b6f3-6397-4348-8a1c-fd6f34dafc00', '07d0c2f5-1b63-4e91-bc2f-eb9cbcd0d69a', 'f0e231e4-4ef2-450f-9118-2458af6fce7a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:58 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:58 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:27:58 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:59 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.info" returned: 0 in 0.687s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.478s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:59 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-8b97c344-cf7e-4529-83f8-1220a65e3033 tempest-ProjectMemberTests-1490863771 None] Create snapshot completed successfully Jul 09 15:27:59 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.676s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:59 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Deleted volume successfully. Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-f39ec492-f450-4058-aa8f-8f3fc1047f3f tempest-ProjectReaderTests-1360878045 None] Lock "cinder-a7b665d6-2690-4298-b0aa-8e286455a138-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-b78301dd-b41d-4d67-a038-f1da7a6f41ff-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Lock "cinder-b78301dd-b41d-4d67-a038-f1da7a6f41ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-2ea310fc-1786-4a77-8b31-6e11c9d84cad" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-2ea310fc-1786-4a77-8b31-6e11c9d84cad" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-b78301dd-b41d-4d67-a038-f1da7a6f41ff" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-b78301dd-b41d-4d67-a038-f1da7a6f41ff" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Deleting offline snapshot b78301dd-b41d-4d67-a038-f1da7a6f41ff of volume 2ea310fc-1786-4a77-8b31-6e11c9d84cad {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] snapshot_file for this snap is: volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f59e608-0099-4197-94f3-524df4a73789]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:59 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Flow 'volume_create_manager' (86c36e7e-375b-4cc5-98d6-4fcc85b5612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bd32e3-1b30-4c47-87c1-01ae45f06441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bd32e3-1b30-4c47-87c1-01ae45f06441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547132930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30af95f-6b5b-4980-83f6-d92f6a15a5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cdce7c454f4bb8944b6c04f8347922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:00Z,use_quota=True,user_id='9ac4fa13ffd949b3ab7724fc7c417ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7835859b-36ea-49c8-92c1-7c9f4da491ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7835859b-36ea-49c8-92c1-7c9f4da491ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a0fed9-2bf9-4622-912f-615841ecabb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a0fed9-2bf9-4622-912f-615841ecabb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b30af95f-6b5b-4980-83f6-d92f6a15a5ee', 'volume_name': 'volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a551d559-6547-4ce8-990c-383444504c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a551d559-6547-4ce8-990c-383444504c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a07c36-39e0-4bc7-9993-e71cee4cd02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:00 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Volume b30af95f-6b5b-4980-83f6-d92f6a15a5ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee', 'volume_size': 1} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547132930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30af95f-6b5b-4980-83f6-d92f6a15a5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cdce7c454f4bb8944b6c04f8347922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:00Z,use_quota=True,user_id='9ac4fa13ffd949b3ab7724fc7c417ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Creating volume b30af95f-6b5b-4980-83f6-d92f6a15a5ee {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:00 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:00 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff Jul 09 15:28:00 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:00 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee 1073741824 Jul 09 15:28:00 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:00 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff" returned: 0 in 0.767s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03950d0-2a88-44fb-ab0c-a8215c7fa91e]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:00 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad Jul 09 15:28:00 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:00 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee 1073741824" returned: 0 in 0.871s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:00 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:00 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee Jul 09 15:28:00 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:01 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad" returned: 0 in 0.808s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:01 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" returned: 0 in 0.623s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:01 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:01 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:01 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff Jul 09 15:28:01 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a07c36-39e0-4bc7-9993-e71cee4cd02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d57289f-4f27-4c06-b280-88870e26524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:01 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Volume volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee (b30af95f-6b5b-4980-83f6-d92f6a15a5ee): created successfully Jul 09 15:28:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d57289f-4f27-4c06-b280-88870e26524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:01 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Flow 'volume_create_manager' (86c36e7e-375b-4cc5-98d6-4fcc85b5612e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:01 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-6546d384-83b3-4301-a86d-8e1df89b5a4d tempest-ProjectReaderTests-1360878045 None] Created volume successfully. Jul 09 15:28:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:02 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Creating offline snapshot 54e54109-28a4-4e76-a894-fd1304896672 of volume b30af95f-6b5b-4980-83f6-d92f6a15a5ee {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:28:02 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7ad8ac-d09b-4b2a-a966-d80df7c1f78d]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:02 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee Jul 09 15:28:02 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:02 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff" returned: 0 in 0.755s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:02 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff Jul 09 15:28:02 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:02 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" returned: 0 in 0.754s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:02 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:02 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 1G Jul 09 15:28:02 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:03 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad.b78301dd-b41d-4d67-a038-f1da7a6f41ff" returned: 0 in 0.683s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-b78301dd-b41d-4d67-a038-f1da7a6f41ff" released by "_delete_snapshot" :: held 3.116s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-2ea310fc-1786-4a77-8b31-6e11c9d84cad" released by "delete_snapshot" :: held 3.151s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:03 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Created reservations ['4ac8befc-fd35-4a0a-9697-3aa98b167bd1', '0dfdafdf-a605-43ca-995a-153dc4737624', '14d1299b-225e-4e02-a97a-56cb3cc3d6b4', '389e434a-6eac-4e77-bc95-624cd63a2b44'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:03 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Delete snapshot completed successfully. Jul 09 15:28:03 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-de77d5ce-1ab8-462e-bd43-4f0b7862d09e tempest-ProjectMemberTests-1490863771 None] Lock "cinder-b78301dd-b41d-4d67-a038-f1da7a6f41ff-delete_snapshot" released by "delete_snapshot" :: held 3.306s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:03 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 1G" returned: 0 in 0.818s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:03 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:03 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 Jul 09 15:28:03 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-2ea310fc-1786-4a77-8b31-6e11c9d84cad-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-2ea310fc-1786-4a77-8b31-6e11c9d84cad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-2ea310fc-1786-4a77-8b31-6e11c9d84cad" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-2ea310fc-1786-4a77-8b31-6e11c9d84cad" acquired by "delete_volume" :: waited 0.022s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[199cbe01-5229-456b-9cf5-bcb4658a5912]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:04 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad Jul 09 15:28:04 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:04 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672" returned: 0 in 0.705s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:04 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 is being set with open permissions: ugo+rw Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:04 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 Jul 09 15:28:04 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:04 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:28:04 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:04 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad" returned: 0 in 0.761s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:05 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad Jul 09 15:28:05 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:05 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672" returned: 0 in 0.669s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:05 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.info Jul 09 15:28:05 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:05 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.692s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:28:05 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-2ea310fc-1786-4a77-8b31-6e11c9d84cad" returned: 0 in 0.674s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-2ea310fc-1786-4a77-8b31-6e11c9d84cad" released by "delete_volume" :: held 1.507s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Created reservations ['34b61b35-6ce2-4144-8dc3-30a908302537', 'b93d27ad-0a84-4c76-aa54-0e95e5c737af', '65562947-c6bc-4f2d-af0c-c569c5bbd2cf', 'a15cdc1f-dc93-402d-a688-9fb35dbef875'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:05 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:28:05 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:05 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.info" returned: 0 in 0.697s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:05 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.info is being set with open permissions: ugo+rw Jul 09 15:28:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:05 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.info Jul 09 15:28:05 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:06 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.709s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:06 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Deleted volume successfully. Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-21f62833-f7ec-41d7-9458-bef255d090a1 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-2ea310fc-1786-4a77-8b31-6e11c9d84cad-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:06 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.info" returned: 0 in 0.671s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.433s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:06 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-91b79ea9-bec7-47f1-9e9f-b082e7186966 tempest-ProjectReaderTests-1360878045 None] Create snapshot completed successfully Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (3333acc0-88fb-443c-9233-52574e52d219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09b6b4f-305d-4e62-8ded-ef8168397321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09b6b4f-305d-4e62-8ded-ef8168397321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1279253548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0370a4-3022-45fb-a785-0c063e0aa832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:07Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5798c19c-a85f-4664-9acc-77fc630edfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5798c19c-a85f-4664-9acc-77fc630edfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9741aef-e7aa-42fd-b2c3-a226d7420d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9741aef-e7aa-42fd-b2c3-a226d7420d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0370a4-3022-45fb-a785-0c063e0aa832', 'volume_name': 'volume-8e0370a4-3022-45fb-a785-0c063e0aa832', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12767b9-a458-4501-a15c-ddda82c8acfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12767b9-a458-4501-a15c-ddda82c8acfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac8048f-115b-4078-a6f9-6cd0431cc15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:06 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Volume 8e0370a4-3022-45fb-a785-0c063e0aa832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0370a4-3022-45fb-a785-0c063e0aa832', 'volume_size': 1} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1279253548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0370a4-3022-45fb-a785-0c063e0aa832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:07Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Creating volume 8e0370a4-3022-45fb-a785-0c063e0aa832 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:06 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:28:06 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:06 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 1073741824 Jul 09 15:28:06 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-54e54109-28a4-4e76-a894-fd1304896672-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Lock "cinder-54e54109-28a4-4e76-a894-fd1304896672-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-54e54109-28a4-4e76-a894-fd1304896672" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-54e54109-28a4-4e76-a894-fd1304896672" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Deleting offline snapshot 54e54109-28a4-4e76-a894-fd1304896672 of volume b30af95f-6b5b-4980-83f6-d92f6a15a5ee {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] snapshot_file for this snap is: volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24786e5-1a0b-4b09-8fa1-9443ae50880c]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:07 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 Jul 09 15:28:07 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:07 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 1073741824" returned: 0 in 0.873s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:07 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:07 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 Jul 09 15:28:07 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:08 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672" returned: 0 in 0.810s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc91cb7-1202-46c0-afa0-f1ea5631e452]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:08 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832" returned: 0 in 0.663s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:08 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee Jul 09 15:28:08 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac8048f-115b-4078-a6f9-6cd0431cc15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0370a4-3022-45fb-a785-0c063e0aa832', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5beceee3-7f20-40fa-89b9-b47c9fe0a80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:08 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Volume volume-8e0370a4-3022-45fb-a785-0c063e0aa832 (8e0370a4-3022-45fb-a785-0c063e0aa832): created successfully Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5beceee3-7f20-40fa-89b9-b47c9fe0a80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:08 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (3333acc0-88fb-443c-9233-52574e52d219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:08 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-fb670780-5991-4664-bd8f-4257d8cb57bd tempest-ProjectMemberTests-1490863771 None] Created volume successfully. Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Creating offline snapshot 97c052b7-773d-47ae-baf7-576833c20edf of volume 8e0370a4-3022-45fb-a785-0c063e0aa832 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e4a7df-fc8b-445d-86b9-a89082e6c501]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:09 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" returned: 0 in 0.830s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:09 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 Jul 09 15:28:09 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:09 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 Jul 09 15:28:09 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:09 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832" returned: 0 in 0.802s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:09 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf 1G Jul 09 15:28:09 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:09 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672" returned: 0 in 0.794s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:10 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672 Jul 09 15:28:10 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:10 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee.54e54109-28a4-4e76-a894-fd1304896672" returned: 0 in 0.667s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-54e54109-28a4-4e76-a894-fd1304896672" released by "_delete_snapshot" :: held 3.202s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" released by "delete_snapshot" :: held 3.233s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:10 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf 1G" returned: 0 in 0.831s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0370a4-3022-45fb-a785-0c063e0aa832 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:10 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Created reservations ['d73edaa0-b97c-4956-abcd-f2f4bbc11eb9', '999372b7-3afa-4124-96b8-9c537ee35a00', 'd1808894-fe76-4fc9-bed8-ad0d79c7cb2a', '6b3139ee-56cd-473f-811f-0022cc667062'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:10 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0370a4-3022-45fb-a785-0c063e0aa832 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf Jul 09 15:28:10 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:10 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Delete snapshot completed successfully. Jul 09 15:28:10 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-80ed095e-ac62-4908-b575-9b2921e9aece tempest-ProjectReaderTests-1360878045 None] Lock "cinder-54e54109-28a4-4e76-a894-fd1304896672-delete_snapshot" released by "delete_snapshot" :: held 3.391s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:11 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0370a4-3022-45fb-a785-0c063e0aa832 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf" returned: 0 in 0.670s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:11 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf is being set with open permissions: ugo+rw Jul 09 15:28:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:11 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf Jul 09 15:28:11 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-b30af95f-6b5b-4980-83f6-d92f6a15a5ee-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-b30af95f-6b5b-4980-83f6-d92f6a15a5ee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:11 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=168,cinder:SELECT=120,cinder:DELETE=12,cinder:INSERT=45 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:28:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:11 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" acquired by "delete_volume" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:11 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4170379f-b1a5-4278-908f-ef7e468fc952]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:11 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee Jul 09 15:28:11 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:12 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf" returned: 0 in 0.702s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:12 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=123,cinder:UPDATE=146,cinder:INSERT=40,cinder:DELETE=15 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:28:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:12 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.info Jul 09 15:28:12 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:12 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" returned: 0 in 0.791s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:12 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee Jul 09 15:28:12 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:12 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.info" returned: 0 in 0.644s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:12 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.info is being set with open permissions: ugo+rw Jul 09 15:28:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:12 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.info Jul 09 15:28:12 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:13 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" returned: 0 in 0.643s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-b30af95f-6b5b-4980-83f6-d92f6a15a5ee" released by "delete_volume" :: held 1.501s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Created reservations ['4b6960fc-587f-4e84-adbd-3f46d889ae04', '5d9bd2e0-b4b2-44d5-87b3-301db6da781d', '778a1519-7d50-4f2e-8f36-e1071c45d045', 'a64ec4e1-3ed9-42d9-acaf-eebad64ef65a'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:13 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:28:13 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:13 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.info" returned: 0 in 0.664s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.405s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:13 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-59d9acb7-9dbc-49d1-84de-44fe4a38c2a5 tempest-ProjectMemberTests-1490863771 None] Create snapshot completed successfully Jul 09 15:28:14 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.617s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:14 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Deleted volume successfully. Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-bb08ab77-51f3-488d-8116-04a3395ab9e5 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-b30af95f-6b5b-4980-83f6-d92f6a15a5ee-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-97c052b7-773d-47ae-baf7-576833c20edf-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-97c052b7-773d-47ae-baf7-576833c20edf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-8e0370a4-3022-45fb-a785-0c063e0aa832" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Flow 'volume_create_manager' (47819715-e91c-4634-a88b-132637a05b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c483de6a-6da2-4874-886c-cb9a55164f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-8e0370a4-3022-45fb-a785-0c063e0aa832" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-97c052b7-773d-47ae-baf7-576833c20edf" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c483de6a-6da2-4874-886c-cb9a55164f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290727108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a647ba-eb27-435d-bef8-3cb11c6a2c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cdce7c454f4bb8944b6c04f8347922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:14Z,use_quota=True,user_id='9ac4fa13ffd949b3ab7724fc7c417ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e42788d-7c6b-4de5-bbd2-3fd85f9d593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e42788d-7c6b-4de5-bbd2-3fd85f9d593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1093cd-ec93-42dd-b00b-3812c4efc253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1093cd-ec93-42dd-b00b-3812c4efc253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a647ba-eb27-435d-bef8-3cb11c6a2c01', 'volume_name': 'volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51fdba1-fd8b-40db-848f-067e8f7cfed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51fdba1-fd8b-40db-848f-067e8f7cfed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cca60b0-45e4-4612-84b5-ccab3fe57efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:14 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Volume e2a647ba-eb27-435d-bef8-3cb11c6a2c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01', 'volume_size': 1} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290727108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a647ba-eb27-435d-bef8-3cb11c6a2c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cdce7c454f4bb8944b6c04f8347922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:14Z,use_quota=True,user_id='9ac4fa13ffd949b3ab7724fc7c417ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Creating volume e2a647ba-eb27-435d-bef8-3cb11c6a2c01 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:14 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-97c052b7-773d-47ae-baf7-576833c20edf" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Deleting offline snapshot 97c052b7-773d-47ae-baf7-576833c20edf of volume 8e0370a4-3022-45fb-a785-0c063e0aa832 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:28:14 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 1073741824 Jul 09 15:28:14 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] snapshot_file for this snap is: volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dfae67-6fe9-4a95-91ef-64fda3297b92]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:14 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf Jul 09 15:28:14 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:15 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf" returned: 0 in 0.760s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:15 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e0370a4-3022-45fb-a785-0c063e0aa832(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:28:15 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 1073741824" returned: 0 in 0.844s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:15 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[644bf708-8b7c-4491-a32b-8e89901709ac]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:15 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 Jul 09 15:28:15 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:15 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 Jul 09 15:28:15 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:16 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" returned: 0 in 0.647s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cca60b0-45e4-4612-84b5-ccab3fe57efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040d5044-20a6-4683-bee2-4d2edcb2e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:16 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Volume volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 (e2a647ba-eb27-435d-bef8-3cb11c6a2c01): created successfully Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040d5044-20a6-4683-bee2-4d2edcb2e47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Flow 'volume_create_manager' (47819715-e91c-4634-a88b-132637a05b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:16 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-ad9c2ad8-32f0-4ce0-bd33-469d363e0297 tempest-ProjectReaderTests-1360878045 None] Created volume successfully. Jul 09 15:28:16 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832" returned: 0 in 0.796s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:16 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf Jul 09 15:28:16 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Creating offline snapshot 2afe56fb-d403-45a8-9a7c-50f7164793cd of volume e2a647ba-eb27-435d-bef8-3cb11c6a2c01 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebdf742-5b3e-4e9a-9ce2-28283f0088c5]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:16 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 Jul 09 15:28:16 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:16 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf" returned: 0 in 0.720s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:16 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf Jul 09 15:28:16 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:17 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" returned: 0 in 0.770s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:17 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd 1G Jul 09 15:28:17 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:17 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:17 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832.97c052b7-773d-47ae-baf7-576833c20edf" returned: 0 in 0.620s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-97c052b7-773d-47ae-baf7-576833c20edf" released by "_delete_snapshot" :: held 3.012s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-8e0370a4-3022-45fb-a785-0c063e0aa832" released by "delete_snapshot" :: held 3.102s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:17 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Created reservations ['00e09b96-2665-4c16-8d33-235a0939fc4c', '5e3c38a9-0d68-419e-a867-d5702e499e80', '04eb525c-a6af-4b01-85d0-8e05001030d5', '71812e80-8308-4da1-ab16-4189f1cfb15e'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:17 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Delete snapshot completed successfully. Jul 09 15:28:17 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7fe04645-3615-4a07-a30c-0e8367a3e487 tempest-ProjectMemberTests-1490863771 None] Lock "cinder-97c052b7-773d-47ae-baf7-576833c20edf-delete_snapshot" released by "delete_snapshot" :: held 3.283s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:18 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd 1G" returned: 0 in 0.785s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:18 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd Jul 09 15:28:18 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-8e0370a4-3022-45fb-a785-0c063e0aa832-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Lock "cinder-8e0370a4-3022-45fb-a785-0c063e0aa832-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-8e0370a4-3022-45fb-a785-0c063e0aa832" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-8e0370a4-3022-45fb-a785-0c063e0aa832" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:18 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38c0324-b3cc-423a-b751-c439ef933260]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:18 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 Jul 09 15:28:18 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:18 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd" returned: 0 in 0.704s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:18 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd is being set with open permissions: ugo+rw Jul 09 15:28:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:18 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd Jul 09 15:28:18 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:19 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832" returned: 0 in 0.760s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:19 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832 Jul 09 15:28:19 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:19 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd" returned: 0 in 0.691s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:19 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.info Jul 09 15:28:19 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:20 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-8e0370a4-3022-45fb-a785-0c063e0aa832" returned: 0 in 0.630s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-8e0370a4-3022-45fb-a785-0c063e0aa832" released by "delete_volume" :: held 1.464s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Created reservations ['bf5657e1-42f3-4d2d-8f76-8688f8329022', '900e6f58-1a84-4139-a81b-8a64707342c8', '8adc9ddf-3cb2-4d63-93f5-2394502f79d1', 'dda1de0c-4125-4ade-b091-ba574f0caeb9'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:20 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:28:20 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:20 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.info" returned: 0 in 0.673s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:20 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.info is being set with open permissions: ugo+rw Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:20 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.info Jul 09 15:28:20 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:20 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.706s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:20 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Deleted volume successfully. Jul 09 15:28:20 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-07f001c5-1946-46d8-b52c-3be5280e707c tempest-ProjectMemberTests-1490863771 None] Lock "cinder-8e0370a4-3022-45fb-a785-0c063e0aa832-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:21 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.info" returned: 0 in 0.696s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.403s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:21 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7464a993-9260-4a97-bb59-4358753f7eaf tempest-ProjectReaderTests-1360878045 None] Create snapshot completed successfully Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (e7282eeb-5006-451a-aec8-b532685eb460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2747db-a806-4fca-a172-f8284920ca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2747db-a806-4fca-a172-f8284920ca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367598592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbbf91dd-b863-402b-afe2-50761bbd66d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:21Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddae79e-9d14-4855-993c-7500b749ba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddae79e-9d14-4855-993c-7500b749ba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1903d43b-cbfe-41ef-be20-270f6c38cc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1903d43b-cbfe-41ef-be20-270f6c38cc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbbf91dd-b863-402b-afe2-50761bbd66d3', 'volume_name': 'volume-cbbf91dd-b863-402b-afe2-50761bbd66d3', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12ec90d-9c57-4b0f-9cd7-61fb1a75c6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12ec90d-9c57-4b0f-9cd7-61fb1a75c6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778b0614-d5c8-4019-9ee4-c8bc9f5a9c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:21 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Volume cbbf91dd-b863-402b-afe2-50761bbd66d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbbf91dd-b863-402b-afe2-50761bbd66d3', 'volume_size': 1} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367598592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbbf91dd-b863-402b-afe2-50761bbd66d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc087ea503484edba2e4eca661ba213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:21Z,use_quota=True,user_id='0f548ae5a50d46f29cf9f394c1de4d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Creating volume cbbf91dd-b863-402b-afe2-50761bbd66d3 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:21 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:21 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 1073741824 Jul 09 15:28:21 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-2afe56fb-d403-45a8-9a7c-50f7164793cd-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Lock "cinder-2afe56fb-d403-45a8-9a7c-50f7164793cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-2afe56fb-d403-45a8-9a7c-50f7164793cd" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-2afe56fb-d403-45a8-9a7c-50f7164793cd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Deleting offline snapshot 2afe56fb-d403-45a8-9a7c-50f7164793cd of volume e2a647ba-eb27-435d-bef8-3cb11c6a2c01 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] snapshot_file for this snap is: volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba6a81c-7281-41cb-98b1-6e358e30eb07]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:21 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:22 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd Jul 09 15:28:22 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:22 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 1073741824" returned: 0 in 0.833s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:22 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 Jul 09 15:28:22 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:22 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd" returned: 0 in 0.783s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[092014f0-2cec-4eda-9272-71ff82c97b63]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:22 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 Jul 09 15:28:22 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:22 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3" returned: 0 in 0.645s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778b0614-d5c8-4019-9ee4-c8bc9f5a9c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbbf91dd-b863-402b-afe2-50761bbd66d3', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4aadf24-0d92-4118-9c2b-f9d0c3cd671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:22 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Volume volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 (cbbf91dd-b863-402b-afe2-50761bbd66d3): created successfully Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4aadf24-0d92-4118-9c2b-f9d0c3cd671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:22 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Flow 'volume_create_manager' (e7282eeb-5006-451a-aec8-b532685eb460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:22 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-d4be291c-b253-4a8f-8e71-d2dddad589fc tempest-ProjectMemberTests-1490863771 None] Created volume successfully. Jul 09 15:28:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:23 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" returned: 0 in 0.766s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:23 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Creating offline snapshot ff488a05-625b-471e-9384-d43950b1a5b8 of volume cbbf91dd-b863-402b-afe2-50761bbd66d3 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:28:23 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd Jul 09 15:28:23 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b848f6-b707-4b88-9a4b-08bb1ed41ee3]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:23 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 Jul 09 15:28:23 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:24 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd" returned: 0 in 0.731s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:24 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd Jul 09 15:28:24 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:24 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3" returned: 0 in 0.790s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:24 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 1G Jul 09 15:28:24 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:24 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01.2afe56fb-d403-45a8-9a7c-50f7164793cd" returned: 0 in 0.643s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-2afe56fb-d403-45a8-9a7c-50f7164793cd" released by "_delete_snapshot" :: held 3.016s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:24 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" released by "delete_snapshot" :: held 3.043s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:25 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Created reservations ['52a4d70e-4f60-476e-a397-d962b16c28be', '7b7c24e1-9a5b-481b-9d64-2a8511c446b5', '5da4b398-b176-4f87-950c-409b3812677e', 'fba2673a-fc5b-49e9-8077-0f9913e4da28'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Delete snapshot completed successfully. Jul 09 15:28:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-451364ac-04f4-4090-945a-ae32d645855f tempest-ProjectReaderTests-1360878045 None] Lock "cinder-2afe56fb-d403-45a8-9a7c-50f7164793cd-delete_snapshot" released by "delete_snapshot" :: held 3.181s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:25 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 1G" returned: 0 in 0.845s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:25 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 Jul 09 15:28:25 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:25 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8" returned: 0 in 0.700s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:25 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 is being set with open permissions: ugo+rw Jul 09 15:28:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:25 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 Jul 09 15:28:25 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-e2a647ba-eb27-435d-bef8-3cb11c6a2c01-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-e2a647ba-eb27-435d-bef8-3cb11c6a2c01-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "cinder-quobyte-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[555cca70-954f-463d-a5cc-5e274d789428]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:26 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 Jul 09 15:28:26 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:26 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8" returned: 0 in 0.636s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:26 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.info Jul 09 15:28:26 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:27 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" returned: 0 in 0.791s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:27 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01 Jul 09 15:28:27 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:27 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.info" returned: 0 in 0.680s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:27 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.info is being set with open permissions: ugo+rw Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:27 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.info Jul 09 15:28:27 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:27 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" returned: 0 in 0.637s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-quobyte-e2a647ba-eb27-435d-bef8-3cb11c6a2c01" released by "delete_volume" :: held 1.489s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Created reservations ['a14f4ba5-101e-410c-9fec-3315b7590cc3', '35dee746-74f1-456b-b947-219977f80363', '3b8d18a3-02e5-4442-b81e-80beacc6b01f', '1ca46e5d-97b4-4c2f-a6f7-e1e2e61d65df'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:27 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:28:27 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:27 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.info" returned: 0 in 0.640s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.399s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:27 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-40165bec-a599-4ce8-8f4d-c2704d3f99a5 tempest-ProjectMemberTests-1490863771 None] Create snapshot completed successfully Jul 09 15:28:28 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.650s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:28 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Deleted volume successfully. Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c122aa76-f432-4d89-8bb4-e8c240c9b366 tempest-ProjectReaderTests-1360878045 None] Lock "cinder-e2a647ba-eb27-435d-bef8-3cb11c6a2c01-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-ff488a05-625b-471e-9384-d43950b1a5b8-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Lock "cinder-ff488a05-625b-471e-9384-d43950b1a5b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-cbbf91dd-b863-402b-afe2-50761bbd66d3" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-cbbf91dd-b863-402b-afe2-50761bbd66d3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-ff488a05-625b-471e-9384-d43950b1a5b8" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-ff488a05-625b-471e-9384-d43950b1a5b8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Deleting offline snapshot ff488a05-625b-471e-9384-d43950b1a5b8 of volume cbbf91dd-b863-402b-afe2-50761bbd66d3 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] snapshot_file for this snap is: volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c80678-6c12-487d-9927-b360d6e57a84]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:29 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 Jul 09 15:28:29 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:29 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8" returned: 0 in 0.831s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:29 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbbf91dd-b863-402b-afe2-50761bbd66d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:28:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b453d00-25e9-4264-90a5-03331e6c4435]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:29 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 Jul 09 15:28:29 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:30 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3" returned: 0 in 0.764s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:30 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 Jul 09 15:28:30 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:31 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8" returned: 0 in 0.704s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:31 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8 Jul 09 15:28:31 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:31 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3.ff488a05-625b-471e-9384-d43950b1a5b8" returned: 0 in 0.642s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-ff488a05-625b-471e-9384-d43950b1a5b8" released by "_delete_snapshot" :: held 3.041s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-cbbf91dd-b863-402b-afe2-50761bbd66d3" released by "delete_snapshot" :: held 3.062s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:32 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Created reservations ['3f4cc8f0-6bb9-4d03-9894-a07f76ec869f', '06f03b54-326e-4ab1-a335-f22c6c4a9ea2', 'b6b7f88a-bdf2-43eb-96e1-9794ea443a81', '38383e81-a81f-410a-8c38-219d33b6e975'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:32 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Delete snapshot completed successfully. Jul 09 15:28:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-411a5a54-f54f-4e21-a500-aadf18c9c68a tempest-ProjectMemberTests-1490863771 None] Lock "cinder-ff488a05-625b-471e-9384-d43950b1a5b8-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-cbbf91dd-b863-402b-afe2-50761bbd66d3-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Lock "cinder-cbbf91dd-b863-402b-afe2-50761bbd66d3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Acquiring lock "cinder-quobyte-cbbf91dd-b863-402b-afe2-50761bbd66d3" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-cbbf91dd-b863-402b-afe2-50761bbd66d3" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:33 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f3b7ba-1a80-4315-9a87-6dd936cf29c1]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:33 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 Jul 09 15:28:33 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:33 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3" returned: 0 in 0.737s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:33 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3 Jul 09 15:28:33 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:34 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-cbbf91dd-b863-402b-afe2-50761bbd66d3" returned: 0 in 0.642s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Lock "cinder-quobyte-cbbf91dd-b863-402b-afe2-50761bbd66d3" released by "delete_volume" :: held 1.432s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:34 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Created reservations ['db9b081d-77a3-4464-be98-1b2a23b5293d', '0ca09c0e-5b70-42b2-ac28-955c3687d5cf', '8a6bc067-538c-4a29-8b37-cf40383339aa', '1fbb1b94-7f7d-49ec-9fcd-2e090f1224d4'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:34 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:34 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:28:34 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:35 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:35 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.635s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:35 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:35 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Deleted volume successfully. Jul 09 15:28:35 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c0654a8d-5d31-4350-b98e-46bc4bc9546e tempest-ProjectMemberTests-1490863771 None] Lock "cinder-cbbf91dd-b863-402b-afe2-50761bbd66d3-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:44 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=60,cinder:SELECT=40,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:28:45 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=45,cinder:INSERT=16,cinder:UPDATE=56,cinder:DELETE=5 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:29:04 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:29:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:04 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:04 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:04 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:29:04 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:05 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:05 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.669s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:05 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:05 devstack cinder-volume[87042]: DEBUG oslo_service.periodic_task [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] Running periodic task VolumeManager._thread_info {{(pid=87042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:29:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread count: 28 {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:29:05 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-b11d8580-f9d7-4b2d-98b3-4b1f49e60410 None None] thread info: [<_MainThread(MainThread, started 129485094830208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Flow 'volume_create_manager' (c8741d4f-e016-42ba-8d24-d9fdf0379d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8719d9d-18e6-4ca6-918b-7261cff0c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8719d9d-18e6-4ca6-918b-7261cff0c57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1410674208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836a4f0f-60b4-4c6f-9f75-48826f7bd051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edf9136b2b1400090f0b4a689ee0a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:10Z,use_quota=True,user_id='76b4435f19924a39bde86e8db5ad9d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9deb31a-2404-4b21-8405-0e8cf8e36fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9deb31a-2404-4b21-8405-0e8cf8e36fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1618165-3e8c-4ff3-a0c9-48afb3f94f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1618165-3e8c-4ff3-a0c9-48afb3f94f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836a4f0f-60b4-4c6f-9f75-48826f7bd051', 'volume_name': 'volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc49731c-1883-4b35-ba5a-6b3bc9c191f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc49731c-1883-4b35-ba5a-6b3bc9c191f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1754a3b2-bce2-4130-9d6a-fc7f9e79e1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:09 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Volume 836a4f0f-60b4-4c6f-9f75-48826f7bd051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051', 'volume_size': 1} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1410674208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836a4f0f-60b4-4c6f-9f75-48826f7bd051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edf9136b2b1400090f0b4a689ee0a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:10Z,use_quota=True,user_id='76b4435f19924a39bde86e8db5ad9d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)}" {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Creating volume 836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:09 devstack cinder-volume[87042]: INFO cinder.volume.drivers.remotefs [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] casted to osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 Jul 09 15:29:09 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 1073741824 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:09 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 1073741824 Jul 09 15:29:09 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:10 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 1073741824" returned: 0 in 0.853s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:10 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:10 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 Jul 09 15:29:10 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:11 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051" returned: 0 in 0.639s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:11 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'} {{(pid=87042) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:11 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1754a3b2-bce2-4130-9d6a-fc7f9e79e1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051', 'volume_size': 1}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55051c2-8a9b-495f-ad0d-b4d8b31173e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:11 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Volume volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 (836a4f0f-60b4-4c6f-9f75-48826f7bd051): created successfully Jul 09 15:29:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55051c2-8a9b-495f-ad0d-b4d8b31173e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:11 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Flow 'volume_create_manager' (c8741d4f-e016-42ba-8d24-d9fdf0379d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:11 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-1f1e9805-f8da-4641-be3e-8a7384d9fd8e tempest-SnapshotDependencyTests-1448435740 None] Created volume successfully. Jul 09 15:29:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:12 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Creating offline snapshot 59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 of volume 836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:29:12 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dc9078-3876-46a5-846a-1f3fb87b5d7f]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:12 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 Jul 09 15:29:12 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:12 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051" returned: 0 in 0.772s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:12 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 1G {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:12 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 1G Jul 09 15:29:12 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:13 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 1G" returned: 0 in 0.777s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:13 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:13 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 Jul 09 15:29:13 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:14 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 -F qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26" returned: 0 in 0.708s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:14 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 is being set with open permissions: ugo+rw Jul 09 15:29:14 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:14 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 Jul 09 15:29:14 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:15 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26" returned: 0 in 0.626s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:15 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.info Jul 09 15:29:15 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:15 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.info" returned: 0 in 0.659s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:15 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.info is being set with open permissions: ugo+rw Jul 09 15:29:15 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.info {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:15 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.info Jul 09 15:29:15 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:16 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.info" returned: 0 in 0.639s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:16 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.269s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:16 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-4faeffb8-ee1a-45b4-ab74-9562dd1c9028 tempest-SnapshotDependencyTests-1448435740 None] Create snapshot completed successfully Jul 09 15:29:17 devstack cinder-volume[87042]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87042) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Flow 'volume_create_manager' (4f7b6b4d-0f0b-4ff5-9041-0f8fa913fb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea84c08-7ed8-4183-aab5-5ccf4d3deea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea84c08-7ed8-4183-aab5-5ccf4d3deea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e141da2-f362-401c-bb41-b0790ff8b33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edf9136b2b1400090f0b4a689ee0a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59cb9e2e-e5df-4f36-b739-8e13d6b8cc26,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:18Z,use_quota=True,user_id='76b4435f19924a39bde86e8db5ad9d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab9dddd-e3f5-4037-980c-7d0fa176657d),volume_type_id=aab9dddd-e3f5-4037-980c-7d0fa176657d)' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec7e80a-6303-463b-af84-e52b9fecf1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec7e80a-6303-463b-af84-e52b9fecf1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0002a1f8-8cd8-4c9c-bc79-3e73defda083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0002a1f8-8cd8-4c9c-bc79-3e73defda083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e141da2-f362-401c-bb41-b0790ff8b33f', 'volume_name': 'volume-6e141da2-f362-401c-bb41-b0790ff8b33f', 'volume_size': 1, 'snapshot_id': '59cb9e2e-e5df-4f36-b739-8e13d6b8cc26'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:17 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d601959-37b4-458a-96ad-4aef50668710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d601959-37b4-458a-96ad-4aef50668710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf10b1f-6366-4dc1-b4a2-1a0fd4a3b950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:18 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Volume 6e141da2-f362-401c-bb41-b0790ff8b33f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e141da2-f362-401c-bb41-b0790ff8b33f', 'volume_size': 1, 'snapshot_id': '59cb9e2e-e5df-4f36-b739-8e13d6b8cc26'} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "cinder-quobyte-59cb9e2e-e5df-4f36-b739-8e13d6b8cc26-6e141da2-f362-401c-bb41-b0790ff8b33f" by "_create_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-59cb9e2e-e5df-4f36-b739-8e13d6b8cc26-6e141da2-f362-401c-bb41-b0790ff8b33f" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Creating volume 6e141da2-f362-401c-bb41-b0790ff8b33f from snapshot 59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 {{(pid=87042) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Selected osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1 as target Quobyte volume. {{(pid=87042) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "cinder-quobyte-6e141da2-f362-401c-bb41-b0790ff8b33f" by "_copy_volume_from_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-6e141da2-f362-401c-bb41-b0790ff8b33f" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] snapshot: 59cb9e2e-e5df-4f36-b739-8e13d6b8cc26, volume: 6e141da2-f362-401c-bb41-b0790ff8b33f, {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf21ec9-dcf2-42eb-a15b-fc2951400ec2]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:18 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 Jul 09 15:29:18 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:18 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26" returned: 0 in 0.731s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Creating direct copy from snapshot {{(pid=87042) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75e4c23-f22d-4d47-9de9-803947663678]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:18 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:18 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 Jul 09 15:29:18 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:19 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051" returned: 0 in 0.733s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:19 devstack cinder-volume[87042]: DEBUG cinder.utils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Path /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f not found in is_blk_device check {{(pid=87042) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:29:19 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:19 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f Jul 09 15:29:19 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:23 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f" returned: 0 in 4.292s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:23 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2fa8ae-4787-4b81-9900-67da0bffe44a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:23 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:23 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 Jul 09 15:29:23 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:24 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051" returned: 0 in 0.898s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:24 devstack cinder-volume[87042]: DEBUG cinder.image.image_utils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Image conversion details: src /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051, size 1024.00 MB, duration 4.29 sec, destination /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f {{(pid=87042) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:29:24 devstack cinder-volume[87042]: INFO cinder.image.image_utils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Converted 1024.00 MB image at 238.54 MB/s Jul 09 15:29:24 devstack cinder-volume[87042]: WARNING cinder.volume.drivers.remotefs [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f is being set with open permissions: ugo+rw Jul 09 15:29:24 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:24 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f Jul 09 15:29:24 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:25 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f" returned: 0 in 0.610s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-6e141da2-f362-401c-bb41-b0790ff8b33f" released by "_copy_volume_from_snapshot" :: held 7.356s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:25 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-59cb9e2e-e5df-4f36-b739-8e13d6b8cc26-6e141da2-f362-401c-bb41-b0790ff8b33f" released by "_create_volume_from_snapshot" :: held 7.383s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:25 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.397s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf10b1f-6366-4dc1-b4a2-1a0fd4a3b950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e141da2-f362-401c-bb41-b0790ff8b33f', 'volume_size': 1, 'snapshot_id': '59cb9e2e-e5df-4f36-b739-8e13d6b8cc26'}' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c99162-305f-4214-85a4-7abf573dcea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:25 devstack cinder-volume[87042]: INFO cinder.volume.flows.manager.create_volume [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Volume volume-6e141da2-f362-401c-bb41-b0790ff8b33f (6e141da2-f362-401c-bb41-b0790ff8b33f): created successfully Jul 09 15:29:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c99162-305f-4214-85a4-7abf573dcea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87042) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:25 devstack cinder-volume[87042]: DEBUG cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Flow 'volume_create_manager' (4f7b6b4d-0f0b-4ff5-9041-0f8fa913fb95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87042) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:25 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-c2496f38-a811-41ac-bd12-1475023801e1 tempest-SnapshotDependencyTests-1448435740 None] Created volume successfully. Jul 09 15:29:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "cinder-59cb9e2e-e5df-4f36-b739-8e13d6b8cc26-delete_snapshot" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-59cb9e2e-e5df-4f36-b739-8e13d6b8cc26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "cinder-quobyte-836a4f0f-60b4-4c6f-9f75-48826f7bd051" by "delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-836a4f0f-60b4-4c6f-9f75-48826f7bd051" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "cinder-quobyte-59cb9e2e-e5df-4f36-b739-8e13d6b8cc26" by "_delete_snapshot" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:26 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-59cb9e2e-e5df-4f36-b739-8e13d6b8cc26" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Deleting offline snapshot 59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 of volume 836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:29:26 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] snapshot_file for this snap is: volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 {{(pid=87042) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:29:26 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9c62a1-b221-4c12-99c0-4f610166921a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:26 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:26 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 Jul 09 15:29:26 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:27 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26" returned: 0 in 0.721s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:27 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.remotefs [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87042) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:29:27 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[313e146b-996b-459e-b690-ffd44a4986ce]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:27 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:27 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 Jul 09 15:29:27 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:28 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051" returned: 0 in 0.729s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:28 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 Jul 09 15:29:28 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:28 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26" returned: 0 in 0.714s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:28 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:28 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26 Jul 09 15:29:28 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:29 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051.59cb9e2e-e5df-4f36-b739-8e13d6b8cc26" returned: 0 in 0.634s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-59cb9e2e-e5df-4f36-b739-8e13d6b8cc26" released by "_delete_snapshot" :: held 2.889s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-836a4f0f-60b4-4c6f-9f75-48826f7bd051" released by "delete_snapshot" :: held 2.910s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Created reservations ['97082bc5-6952-41af-ae7f-c5206465cc08', 'b23b692e-dbe8-402c-8b0f-8e4fd84468d4', '4ceb9238-1f39-4910-a538-0a5bf5d8278f', '772b9501-254b-429e-b4c9-a6b097372c94'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:29 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Delete snapshot completed successfully. Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-2de36898-e8ef-44fa-a3b5-e5ae3b02f667 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-59cb9e2e-e5df-4f36-b739-8e13d6b8cc26-delete_snapshot" released by "delete_snapshot" :: held 3.030s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "cinder-836a4f0f-60b4-4c6f-9f75-48826f7bd051-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-836a4f0f-60b4-4c6f-9f75-48826f7bd051-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "cinder-quobyte-836a4f0f-60b4-4c6f-9f75-48826f7bd051" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-836a4f0f-60b4-4c6f-9f75-48826f7bd051" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d4052a-0b53-4237-ba3d-f12e63f304de]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:29 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:29 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 Jul 09 15:29:29 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:30 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051" returned: 0 in 0.718s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:30 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:30 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051 Jul 09 15:29:30 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:31 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-836a4f0f-60b4-4c6f-9f75-48826f7bd051" returned: 0 in 0.630s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-836a4f0f-60b4-4c6f-9f75-48826f7bd051" released by "delete_volume" :: held 1.401s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Created reservations ['e1c061fc-10c9-42ee-9cd1-24a9b831cff8', '15131ee7-a187-49f6-958a-59b18a20754b', 'dd2a8383-7a05-4e83-9ba5-821d533b72ef', 'c0ee5513-cce4-4dd3-8141-b29d247ceafe'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:31 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:29:31 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:31 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.626s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:31 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Deleted volume successfully. Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-7f34da0b-5af6-4607-987c-4319bad3be56 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-836a4f0f-60b4-4c6f-9f75-48826f7bd051-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:31 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "cinder-6e141da2-f362-401c-bb41-b0790ff8b33f-delete_volume" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-6e141da2-f362-401c-bb41-b0790ff8b33f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "cinder-quobyte-6e141da2-f362-401c-bb41-b0790ff8b33f" by "delete_volume" {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:32 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-6e141da2-f362-401c-bb41-b0790ff8b33f" acquired by "delete_volume" :: waited 0.015s {{(pid=87042) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:32 devstack cinder-volume[87042]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4a4156-9131-49a9-8d5a-bcb943d55a9a]: (4, 'qcow2') {{(pid=88299) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:32 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f Jul 09 15:29:32 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:32 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f" returned: 0 in 0.727s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:32 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:32 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f Jul 09 15:29:32 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:33 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc/volume-6e141da2-f362-401c-bb41-b0790ff8b33f" returned: 0 in 0.615s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:33 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-quobyte-6e141da2-f362-401c-bb41-b0790ff8b33f" released by "delete_volume" :: held 1.377s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:33 devstack cinder-volume[87042]: DEBUG cinder.quota [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Created reservations ['9aaace8b-091b-4821-91c3-f962a188ca0c', '6b8e9e1b-35c1-45c4-a565-b7b2bbec19a8', 'f3f79a59-5f2e-4fa0-8166-708486bf16ed', '6eb00cd9-8c5a-4014-bb9f-ffb2ca5a1420'] {{(pid=87042) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1': None} {{(pid=87042) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:33 devstack cinder-volume[87042]: DEBUG cinder.volume.drivers.quobyte [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a53dcc93-0c27-4cc1-8b5e-2d15ed5e91c1'] {{(pid=87042) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.lockutils [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87042) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:33 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:33 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc Jul 09 15:29:33 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:34 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:34 devstack cinder-volume[87042]: DEBUG oslo_concurrency.processutils [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9140de48deefe0b7cb96a4bb8e8ceebc" returned: 0 in 0.627s {{(pid=87042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:34 devstack cinder-volume[87042]: DEBUG cinder.manager [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Notifying Schedulers of capabilities ... {{(pid=87042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:34 devstack cinder-volume[87042]: INFO cinder.volume.manager [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Deleted volume successfully. Jul 09 15:29:34 devstack cinder-volume[87042]: DEBUG cinder.coordination [None req-15ddb187-c8d6-49e5-9ee1-e585409dde46 tempest-SnapshotDependencyTests-1448435740 None] Lock "cinder-6e141da2-f362-401c-bb41-b0790ff8b33f-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=87042) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:43 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:UPDATE=23,cinder:SELECT=29,cinder:INSERT=5 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:29:44 devstack cinder-volume[87042]: DEBUG dbcounter [-] [87042] Writing DB stats cinder:SELECT=18,cinder:INSERT=9,cinder:UPDATE=33,cinder:DELETE=5 {{(pid=87042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}